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MULTI-AXIS JOYSTICK AND TRANSDUCER MEANS THEREFORE 



This application is an international application and claims the benefit of United States 
Provisional Application No. 60/372,216, filed 12 April, 2002, hereby incorporated by 
5 . reference 

I. Technical Field 

The present invention relates to multi-axis input devices such as joysticks for use 
10 in, but not limited to, control of computers, control of computer graphics applications in 
the field of computer-aided design, computer games, and for control of machines such as 
construction equipment, robotic manipulators, vehicles and the like. The multi-axis 
optical position transducer herein disclosed may have many other applications, 
particularly where small size or low cost is important. 
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EL Background 



Various attempts have been made to develop commercially viable six axis 
joysticks. The complexity of the prior art designs has resulted in expensive products 

20 which may be only affordable for computer aided design and other high value industrial 
and commercial applications. The "SpaceOrb ®", which was developed by Spacetec 
IMC Corporation and marketed as a computer gaming peripheral device for several years 
during the late 1990's, was ultimately discontinued, perhaps due to its complexity and 
manufacturing cost relative to its roughly $50 to $100 retail price. Patents related to the 

25 Spacetec SpaceOrb® which were assigned to Spacetec IMC Corporation as of date of 
issue include U.S. Pat. No. 5,591,924 to Hilton, U.S. Pat. No. 5,706,027 to Hilton et al, 
and U.S. Pat. No. 5,798,748 to Hilton et al. Hilton was also granted an earlier patent in 
the same field, U.S. Pat. No. 4,811,608, assigned as of date of issue to Spatial Systems 
Pty Limited. The six axis devices currently offered by Logitech (which may have 

30 purchased Spacetec IMC Corp) include the Spaceball® and Spacemouse®, the January 
2002 retail prices of which were approximately $500 each. 
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Other attempts have been made to use optical position transducers in a six-axis 
device. For example, U.S. Pat App. No. 20010038380 to Salcudean et al discloses the 
use of light sources and sensors mounted to both the stationary and movable elements of a 
joystick. Such a scheme may entail unnecessary complexity of construction and may 
5 results in a less reliable and less robust device due to the requirement for movable 
electrical components requiring flexible connections. 

Many other methods have been utilized to achieve six axis or multi-axis control. 
For example, multi-axis input devices have also been built around conventional metal foil 
strain gage technology and also using wire strain gages. Such devices may essentially be 
10 force input devices and may fail to provide the operator with any useful deflection 
feedback. The primary signals from such devices may require careful shielding and 
subsequent amplification to compensate for the inherently low gage factor of the strain 
gages. 

U.S. Pat. No. 4,76,524 to Jenkins and U.S. Pat. No. 5,767,840 to Selker are 

1 5 examples of prior art in which the use of strain gages is disclosed. The use of such strain 
gages may be complicated by temperature-induced errors and low gage factors, both of 
which can add to the difficulty of signal processing and signal shielding. Furthermore, 
the allowable strain may be barely perceptible to the operator, and may result in a lack of 
useful and desirable deflection feedback to the operator. Furthermore, the low strains 

20 may preclude the use of mechanical stops to prevent overloading the strain gages. Strain 
gages may be sized to include a factor of safety with respect to loads which may decrease 
their already poor gage factor even further. Even with a factor of safety, the devices 
using strain gages may be unsuitable for applications such as computer games, which may 
often be dropped on the floor by children. 

25 Other six axis joystick designs of prior art utilize a plurality of linear variable 

differential transformers, variable inductors, or other linear discrete mechanical 
displacement transducers. Some of these six-axis input devices have been based on 
spring centered LVDT's (linear variable differential transformers) in a Stewart platform 
configuration. Such devices may be expensive and fragile in comparison to the 

30 economical and robust construction of a 6 axis input device built in accordance with the 
present invention. The multiple mechanical joints of the prior art may result in a trade-off 
between precision and cost. 

Ah example of a simplified device of the Stewart platform variety is disclosed in 
U.S. Pat No. 6, 329,812 Bl to Sundin, wherein the important consideration of cost is 
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addressed. Overall complexity may not be avoided, however, because of the need to 
shield radio frequency interference and because of interference effects between adjoining 
inductive springs. A further disadvantage of the Sundin design may be that the multiple 
springs could result in an assembly that is subject to unacceptable resonant vibrations if 
5 used in association with construction equipment or moving vehicles. Such vibration may 
include resonance of the active grip on its spring(s) or may involve lateral or higher mode 
* vibrations within the springs themselves. 

Yet another known six-axis joystick may be comprised of a plurality of magnetic 
sensing coils and multiple movable magnets. Examples of patents disclosing magnetic 
10 position detection include U.S. Pat App. No. 20010055002 to Endo and U.S. Pat. No. 
5,687,080 to Hoyt et al. These designs may often be much more complex and expensive 
than the present invention and may not provide any inherent shielding from ambient 
magnetic flux 

Yet another method is the coupling of two three-axis controllers to attain six axes 

15 control as disclosed in U.S. Pat No. 5,749,577 and U.S. Pat No. 6,033,309 to Couch et 
al. Such a method may be more expensive than the present invention and may lack an 
intuitive six-axis interface. 

The large size of many of the devices built in accordance with prior art may result 
in unintended and undesirable coupling between the horizontal axis of rotation and the 

20 horizontal axis of translation. Such coupling may require subsequent diagonalization by 
means of signal processing with a corresponding loss in precision and dynamic range of 
the device. Such undesirable coupling may have been difficult to avoid in the prior art 
because of the expense and technical obstacles, which the required miniaturization of 
such prior art designs may entail. 

25 The transducer systems of the six axis joysticks of the prior art may have 

generally been physically too large or heavy for many applications such as incorporation 
into keyboards or hand held computers, for positioning as extensions of other control 
handles or grips, or for enclosing near the center of the user's hand within a conventional 
joystick such as that disclosed in U.S. Pat. No. Des. 381,701 to Salinas. 

30 The need for hand stabilization during trackball use while operating an aircraft has 

been recognized. Dassault Aviation has adapted a conventional two-axis track ball to 
include a palm rest to facilitate reliable (two axis) cockpit display cursor control under 
turbulent flight conditions (PROFESSIONAL PILOT magazine/January 2002). Six axis 
devices of the prior art may be too bulky to incorporate within such a palm rest In fact, 
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many six axis input devices of the prior art may have been so bulky that they no longer 
resemble sticks and may have therefore not even been referred to as "joysticks". 

Various multi-axis input devices or "joysticks" that utilize some form of magnetic 
field measurement such as Hall effect sensing are known. Examples of patents related to 
5 multi-axis input devices or joysticks which disclose Hall Effect sensing include U.S. Pat 
No. 5,959,863 to Hoyt et al and U.S. Pat. No. 5,687,080 to Hoyt et al. U.S. Pat. 
Application 2001/0055002 to Endo also discloses the use of Hall Effect sensing for multi- 
axial computer input devices. 

Several articles on the subject of six axis user interfaces by Shumin Zhai, Ph.D. 
1 0 have been published. These include: Human Performance in Six Degree of Freedom 
Input Control, Interaction in 3D Graphics, and User Performance in Relation to 3D Input 
Device Design. 

It is an object of this invention to provide a low-cost robust alternative to current 
multi-axis computer input devices. In particular, an object of this invention may be to 

15 provide a device sufficiently low in cost to be attractive for use in conjunction with 
computer games, and the like, as well as sufficiently simple and robust for use in, but not 
limited to, industrial applications. Currently available devices may be prohibitively high 
priced for the computer gaming industry and may be too fragile for a typical construction 
equipment application. The present invention, in contrast, may require only two moving 

20 parts, which can be a simple coil spring and a simple plastic knob with an internal 
reflective surface, for example. The plastic knob of the present invention may have about 
the same manufacturing cost as an ordinary flashlight reflector. The overall 
manufacturing cost of the present invention may be significantly lower than the 
manufacturing cost of any other prior art six-axis joystick and may be in fact lower than 

25 the manufacturing cost of typical two axis joysticks. 

A further object of this invention may be to provide a simple easy-to-manufacture 
6-axis computer input device, consisting of as few components as possible. The preferred 
design may incorporate all, 7 for example, transducers onto a single printed circuit board 
or into a monolithic electro-optical package. 

30 Another object of this invention may be to provide a high quality and high 

precision signal by optimally locating a high-resolution transducer element with respect 
to the grip and the user's hand and wrist to yield well conditioned transform equations. 



4 
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Yet another object of this invention may be to provide a durable, robust multi-axis 
input device suitable for such applications as control of machinery and construction 
equipment, and the like. 

A further object of this invention may be to allow greater control in industrial and 
5 construction equipment applications in general, where multi-axis controls may have been 
technically deficient and commercially unattractive. 

Another object of this invention may be to provide a transducer element of 
sufficiently small size that it can be centrally located within the handle of a gaming 
joystick, in line with the parallel-to-the-Ulna-and-Radius-bones axis of wrist rotation 
1 0 instead of below said axis, as may often be the case for prior art designs. 

A further object of this invention is to provide a transducer element which may be 
of sufficiently small size to permit easy finger-tip manipulation of the active grip, while 
leaving space within the user's hand for a stationary grip element or a palm rest which 
may be needed to stabilize the user's hand and arm so that the multi-axis joystick 
1 5 functions can be safely used in moving vehicles on land, in water, in air or in space. 

m. Disclosure of Invention 

Various embodiments designed to meet the forgoing objectives are summarized as 
20 follows: 

In one embodiment, the present invention may be comprised of a movable "active 
grip" which incorporates six or so mirror facets fixed thereto and which may be resiliently 
mounted on a coil spring, for example. A photo transducer array, comprised of one or 
more photo emitters and one or more photo detectors, may be fixedly mounted a short 

25 distance away opposite the movable mirror facet assembly. The lengths of six unique 
light paths connecting the photo emitter(s) with the photo sensor(s) by way of the mirror 
facets may define the coordinates in six degrees of freedom of the active grip and its 
mirror facets relative to the photo transducer array. The brightness as measured by a 
photo detector at the end of each light path may generally be an inverse square function of 

30 the light path length. Any translational or rotational movement about any axis of the 
active grip may result in an altered pattern of brightness. The brightness pattern may be 
converted to electronic form for use in a digital computer, for example, or may be 
transmitted along fiber optic cables as an analog brightness signal. 



5 
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In general, the following descriptions of the locations of photo emitters and photo 
detectors may be intended as examples only and are not intended to be limiting with 
respect to the disclosure of this invention or to the interpretation of any claims. In 
particular, the relative positions of photo emitters and photo detectors may be, in almost 
5 all cases, interchangeable. In certain cases individual discrete devices may be able to 
function as both emitter and detector. Simple changes in circuitry may facilitate the 
exchange in position of the emitters and detectors. For example, in the case of six 
emitters surrounding a single detector, the emitters may be energized one at a time so the 
signal generated by the detector can be associated with a unique light path and its 

1 0 corresponding emitter. Such an arrangement can be advantageously used to reduce to one 
the number of analog to digital conversion channels required on a programmable interface 
controller or other signal conversion device. Such an arrangement can be accomplished 
using standard components and known electronic engineering principles. 

The terms "photo emitter" and "photo detector" are intended to be interpreted 

1 5 broadly and to encompass any means of or element for directing or converting light or 
any interface through which light is conveyed, whether or not the light originates or 
terminates within the device contemplated by this invention. For example, sun light 
could be used to illuminate a target from which point it would reflect to a plurality of 
movable mirrors from which it would be further reflected to light receptors from which it 

20 might be further transmitted as light guided by a fiber optic cable to a remote location 
beyond some physical boundaries. Examples of photo emitters may include, but not be 
limited to, light emitting diodes of any wavelength including visible and infrared, laser 
diodes, gas discharge tubes, incandescent light bulbs, and other equivalent element known 
or not known at this time. Examples of detectors include photo diodes, phototransistors, 

25 Cadmium Sulfide photo resistors, photovoltaic cells, phototubes, and other equivalent 
means known or not known at this time. The following terms as used in the specification 
can be used in their traditional sense and can have the following additional indicated 
meanings. The term "Stewart platform" may include a "hexapod" or octahedral parallel 
linkage of the type commonly used as the motion platform for flight simulators. 

30 The term "slave platform" may include a platform the position of which is 

controlled by a plurality of remotely controlled actuators or its virtual equivalent in the 
case of manipulation of a computer model. 

The term "sensing assembly" may include the assembly of one or more discrete 
sensors or a single multi-axis sensing element. 
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The term "sensor base" may include the relatively stationary object to which the 
sensing assembly is attached. 

The term "sensor platform" may include the portion of the device, which is moved 
by the operator including the "active grip". 
5 The term "active grip" may include the movable portion of the device the position 

of which is moved by the operator and the movement of which results in a change in 
output signal. 

The term "restoring element" may include a device such as a spring or elastomeric 
structure that contributes to restoring the moving platform to a minimum energy position 
1 0 after the removal of deflecting forces. 

The term "restoring system" may include the system comprised of one or more 
"restoring elements" which restore the moving platform to a minimum energy position 
after the removal of deflecting forces. 

The term "structured light" may include light projected in a fixed, preferably high 
1 5 contrast, pattern which may be used to measure as an image taken from another vantage 
point the position in space of an otherwise featureless surface. 

The term "MEMS" refers to a class of miniature mechanical devices 
manufactured and packaged in a manner similar to that used for electronic integrated 
circuit chips. 

20 The term "CCD array" refers to an optical image sensing device based on charge 

coupled devices, as are commonly used in video cameras and electronic still cameras. 

The term "side looking" as it applies to photo emitters and photo detectors refers 
to devices which are oriented in a circuit board mountable package in a manner which 
results in emission of or sensitivity to light generally parallel to the plane of the circuit 

25 board. 

The term "joystick" may broadly include any handle, knob or other device which 
may be physically grasped, engaged, or physically moved to in a manner which generates 
an electrical, optical, electromagnetic, or other signal representation of movement of or 
application of forces to said device. 
30 The term "spatially varying reflectivity" may include the marginal edges of a 

reflecting surface, varying specularity of surfaces, varying reflectivity of surfaces, 
varying color of surfaces, transparent features, opaque features, grey scale features, bar 
code features, printed features, prismatic elements, refractive elements, etc. 
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In accordance with one aspect of the invention, the active grip may incorporate a 
system of optical elements such as mirrors or prisms, which control the light paths 
between one or more light sources and one or more light detectors. 

In accordance with a further aspect of the invention, a single photo detector may 
5 be used in conjunction with multiple switched light sources in order to reduce analog to 
digital conversion requirements to a single channel. 

In accordance with a further aspect of the invention, in conjunction with multiple 
switched light sources, multiple photo detectors may be connected in parallel to a fewer 
number , such as one, of analog input channels, thus reducing the required number of 
1 0 analog to digital conversion channels 

In accordance with another aspect of the invention, a single monolithic photo 
transducer package, which may be similar in construction to a seven segment LED 
package, may function as either one of or both of both photo emitter and photo detection 
elements. 

15 In accordance with a further object of this invention, six infrared light emitting 

diodes and one or more photo diodes may be mounted to a printed circuit board to which 
transparent waveguides are subsequently molded and over which an opaque material may 
be molded, thus creating a compact and robust electro-optical package. 

In accordance with a further object of this invention, the infrared light emitting 

20 diodes and photo diodes may be coplanarly mounted to the printed circuit board and the 
waveguides may incorporate internal reflective surfaces which project the light in a 
generally radial direction from the transducer axis of symmetry. 

In accordance with a further aspect of the invention, a signal processing chip, such 
as an Analog Device's PIC, may be embedded along with the optical transducers within 

25 the transducer package. By this means, any required sequencing of photo emitters, 
scaling and normalization of data, as well as efficient digital transmission of the output 
signal may be accomplished within an ergonomically adaptable and compact device. 

In accordance with a further aspect of the invention, an image detector such as a 
CCD array may be used to measure the position of an image controlled by the multi-axis 

30 position of a movable grip. 

In accordance with a further aspect of this invention, a very wide angle lens such 
the type used to preview visitors through doors may be used to project the position 
sensitive image of an interior surface of a movable grip onto an image transducer such as 
a conventional CCD array. 

8 
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In accordance with a further aspect of this invention, the interior of a movable grip 
may feature a pattern of reflective areas and non-reflective areas in a generally three 
lobed form. 

In accordance with a further aspect of the invention, a CCD array attached to a 
5 first movable portion of a joystick, the base for example, may be used to measure the 
spherical angles to three points, for example on a second movable portion of said joystick, 
the interior of the grip, for example. The two spherical angles for each of three relatively 
movable points constitute 6 data signals which may be relatively easily processed by the 
general method disclosed herein, for example. In accordance with a further aspect of this 
1 0 invention, illumination of a first movable portion may be by means of a photo emitter 
fixed to a second movable portion located coaxially with a lens means used to focus a 
position sensitive image onto a CCD array. 

In accordance with a further aspect of this invention, the interior of a movable grip 
may feature a pattern of reflective areas and non-reflective areas in a generally multi- 
1 5 lobed form. 

In accordance with a further aspect of the invention, structured patterns of light 
may be projected from a first element onto a second element, movable in multiple axes 
relative to the first element The resulting patterns of illumination may be used to 
determine the relative multi-axial positions of said first and second elements by means of 

20 detectors or imaging apparatus attached to the first element, for example. Such an 
arrangement may be used to determine the relative position of a reflective second element 
without the requirement for a second element surface of spatially varying reflectivity. 

In accordance with a further aspect of the invention, a monolithic photo transducer 
package as herein described may include an element to secure one or more springs. 

25 In accordance with a further aspect of the invention, photo emitters and photo 

detectors, which may be more cheaply available with integral collimating lenses, may be 
embedded in an opaque insulating compound while held in position, by being fixed to a 
printed circuit board for example, then may be subsequently machined or sanded as an 
assembly to create a suitable optical surface. 

30 In accordance with a further aspect of the invention, alternating side looking 

emitters and side looking photo diodes may be located facing outward around the 
periphery of a printed circuit board, said circuit board being mounted to the first of at 
least two movable elements (preferably the base). The second element (preferably the 
grip), movable in multiple axes relative to the first element, includes reflecting means 
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which generally surrounds the first element at a distance sufficient to allow necessary 
radial movements. The reflecting means may be a patterned surface of cylindrical, 
spherical, or toroidal form for example. 

In accordance with a further aspect of the invention, the photo detectors may be 
5 connected in parallel. 

In accordance with a further aspect of the invention, the reflecting means may be a 
generally cylindrical mirror with spatially varying reflectivity. 

In accordance with a further aspect of the invention, the reflecting means may be a 
generally toroidal mirror with spatially varying reflectivity. 
10 In accordance with a further aspect of the invention, the reflecting means may be 

retroreflective, e.g., a plurality of conical reflecting surfaces. 

In accordance with a further aspect of the invention, the reflecting means may be 
polygonal. 

In accordance with a further aspect of the invention, the reflective means may be 
1 5 generally spherical. 

In accordance with a further aspect of this invention, a single generally planar 
spring may be used to provide a restoring force to the movable grip. 

In accordance with a further aspect of this invention, said generally planar spring 
may be provided with positive locating features such as holes to control the alignment 
20 between the grip and the base during assembly. 

In accordance with a further aspect of this invention, a generally planar bellows 
means may be provided in conjunction with said generally planar spring. 

In accordance with a further aspect of this invention, a non-circular hole in the 
grip may engage a non-circular transducer supporting pedestal in order to limit the extent 
25 of movement of the grip relative to the base. 

In accordance with a further aspect of this invention, said non-circular hole is a 
slot with generally parallel sides and the pedestal is of similar but smaller cross section. 

In accordance with a further aspect of the invention, a suitable reflector element 
may be provided to facilitate the use of a standard LED display package, such as a 7 
30 segment LED numeric display for light emission and/or light detection means. 

In accordance with another aspect of the invention, optical guides may be used to 
alter the effective geometric locations of a standard multi-segment LED to a more 
optimum motion transducer configuration such as a six-sided isometric array. 



10 
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In accordance with another aspect of the invention, refractive element or lens 
means such as inclined surfaces or Fresnel lenses may be integral with or disposed above 
the light transducer array. 

In accordance with another aspect of the invention, the movable reflective element 
5 may be comprised of non-flat reflecting segments such as concave mirrored surfaces, for 
example, in order to obtain the desired response characteristics from the device. 

In accordance with another aspect of the invention, the movable reflector means 
may be comprised of one or more retro-reflectors, the movement of which may alter the 
degree of coupling between one or more photo emitters and one or more photo detectors. 
10 In accordance with a further aspect of the invention, the degree of coupling of 

emitter/detector pairs may increase with distance to a corresponding retro-reflector due to 
an increase in the degree of overlap of the respective cones of brightness and sensitivity 
with increased distance. 

In accordance with another aspect of the invention, the degree of coupling of 
15 adjacent emitter/detector pairs may decrease with distance to a corresponding retro- 
reflector due to inverse-square distance principles. 

In accordance with a further aspect of the invention, surfaces, which may be retro- 
reflective along one axis, but conventionally reflective along another axis, may be 
mounted to a movable active grip in order to produce position measurements in 
20 conjunction with a seven-transducer hexagonal array, for example. 

According to a further aspect of the invention, the active grip may be fitted with 
grooved mirror segments, analogous to a Fresnel lens, and may be used to control the 
various light paths. 

In accordance with another aspect of the invention, gain calibration of the various 
25 photo emitters and photo detectors may be achieved by interposing between said 

transducers and reflecting elements a calibration mask element, the optical transmissivity 

of which may be mapped and scaled to provide a desirable balance of signals over the 

intended range of displacement and to compensate for the manufacturing induced 

variations in the characteristics of each of the discrete devices. 
30 In accordance with yet another aspect of the invention, a lens element and 

calibration mask means may be combined functions of a single component. 

In accordance with another aspect of the invention, an extra light path may be 

provided in order to calibrate brightness, which may change due to voltage fluctuations, 

temperature changes, etc. 

11 



WO 03/088204 PCT/US03/11614 

In accordance with another aspect of the invention, a light baffle may be provided 
which may also serve to precisely locate and orient the optical components on a printed 
circuit board, for example. 

In accordance with yet another aspect of the invention, fiber optic guides may be 
5 used to convey light from a single source to multiple, six for example, projection points. 

In accordance with another aspect of the invention fiber optic guides may be used 
to convey light from multiple detection points to a single photo detector. 

In accordance with another aspect of the invention, fiber optic guides may be used 
to convey light from a single photo emitter to multiple emission points. 
10 In accordance with a further aspect of this invention, time-of-flight criteria may be 

used to measure the varying optical distances between the various optical emitters and 
detectors of this invention. Such time-of-flight measurements may be made with known 
optical distance measuring circuitry and optical transducers. 

In accordance with a further aspect of this invention, a unique optical delay line 
1 5 may be provided in series with each of, six, for example, light (distance measuring) paths 
for the purpose of time multiplexing optical time-of-flight signals. This scheme may 
facilitate the use of a single photo-detector channel and may also simultaneously facilitate 
the use of a single photo-emitter. 

In accordance with a further aspect of this invention, a multi-axis interferometric 
20 position measurement device may be utilized for the purpose of obtaining simultaneous 
precise multi-axis measurements. Such a device may be constructed by the addition of a 
direct (not affected by sensor platform deflections) reference light path from a common, 
preferably coherent, light source to each of six, for example, photo-sensors. 

In accordance with a further aspect of the invention, a photo-emitter, reference 
25 light paths, and photo-detectors may be all contained within a monolithic optic/electronic 
package. 

In accordance with a further aspect of the invention, an embodiment of this 
invention may be constructed wherein light passes through a liquid or gel in its path from 
photo-emitter to mirror to photo-sensor. Such a scheme could be used, for example to 
30 minimize undesirable reflections or to exclude water or dirt from the optical paths. 

In accordance with a further aspect of this invention, said liquid or gel may have a 
controlled opacity so as to enhance or change a signal with a change in optical path 
length. 
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A further aspect of the invention may be the addition of a tare switch function to 
sense whether the device is being operated or not Such a tare switch function can be 
used to provide a null output and an optional control lock signal whenever the device is 
not being used. This scheme may serve to compensate for null point drift due to factors 
5 such as temperature change or a change in the orientation of the device with respect to 
gravity. This scheme may also render harmless any tendency of the active grip assembly 
to vibrate in response to ambient mechanical excitation in the absence of the damping 
effect of the user's hand 

According to a further aspect of the invention, a tare switch function may be 
1 0 accomplished by a capacitive touch sensor element, a mechanical switch element, or by 
means of software algorithms designed to detect the absence of hand initiated signals. 
Tare switches may be mounted, for example to a palm rest, a wrist rest, or to the active 
grip of the device. 

According to a further aspect of the invention, electrical connection to a tare 

1 5 switch element may be through one or more resilient elements as, for example, through a 
spring supporting the active grip. 

According to a further aspect of this invention, a tare switch function may serve to 
measure the applied force due to the weight the operator's hand and forearm on a 
joystick, for example. In this embodiment, an initial signal may represent forces due to 

20 weight, while a subsequent signal could represent said weight plus intended operator 
inputs. A tare function element, which could be implemented by -either hardware or 
software, may cause the weight component to be ignored or 'tared out". The 
aforementioned scheme may then allow an operator to 'comfortably rest the weight of his 
or her hand and forearm on said joystick prior to the transmission or utilization of the 

25 output signal of said joystick. In this manner the joystick might first function to measure 
the weight effects of the user's hand and forearm, then subsequently function to transduce 
the intended inputs of the operator. The transition from weighing function to transducer 
function could be accomplished purely by software using appropriate time delays, or 
could be activated by various forms of physical tare switches. For example, a general 

30 whole-grip capacitive touch sensor could be used in conjunction with a timer function to 
allow one second, for example, for weighing of the user's hand, after which any further 
change in signals may be machine interpreted as an intended operator instruction. As 
another example, a finger operated switch could be pressed at will by the operator to reset 
the tare function to zero at any time. 

13 
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Various schemes may be used to maximize the usefulness of the signals generated 
by the device of this invention. For purposes of controlling computer graphics, it may be 
very advantageous to use software to interpret the intent of the operator, rather than 
simply transform displacement generated signals to velocity of the object such as a solid 
5 model or camera view-point being manipulated According to one embodiment of this 
invention, the virtual object being controlled may be assigned a virtual mass, center of 
gravity location and moments of inertia about each axis. The output signals from the 
device of this invention may then be translated to effective forces acting on said virtual 
mass. In this manner, smooth and predictable movements may be easily obtained. 
10 According to a further aspect of this invention, proportional/integral/derivative control 
schemes may be used with coefficients selected so as to most closely meet the operator's 
intent. 

In accordance with another aspect of the invention, the origin of the x, y, and z- 
axis may be offset with software to be located at the natural pivot point of the user's wrist 
1 5 even though the physical device may remain at a location where it can be gripped by the 
user's hand or fingers. 

In accordance with a further aspect of the invention, the orientations of the x, y, 
and z axis may be rotated to suit the user. 

In accordance with a further aspect of the invention, software may be used to 
20 override operator generated signals to prevent buckling, collisions, or other undesirable 
positions of a slave platform or a device mounted to such a platform. 

In accordance with another aspect of the invention, the coordinates of the device 
may be transformed to correspond with a dynamically changing coordinate system or 
alternative coordinate systems. Changes in coordinate transformation may be made in 
25 real time as in following a moving machine, for example. 

In accordance with another aspect of the invention, the coordinates of the multi- 
axis joystick may be transformed to control construction or logging machinery or 
attachments such as blades, loader buckets, lifting forks, augers, pavement breakers, 
manipulators, and the like. 
30 In accordance with a further aspect of the invention, sensors such as MEMS 

accelerometers and angular rate sensors may be attached to various portions of machinery 
to be controlled in order to accomplish real time coordinate transformations. In such an 
application, the possibly higher accuracy of customary absolute angle and position 

measuring devices may not be required and may be expensive. Such a control scheme in 
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accordance with this invention may be particularly attractive for construction equipment 
not originally equipped with position sensors and for hexapod (Stewart Platform) 
implementations for which the total cost of six absolute position sensors may be 
significant. 

5 In accordance with a further aspect of this invention, a hexapod may be equipped 

with accelerometers or rate sensors at several locations (three for example) on each of the 
base platform and the slave platform, as well as near end of each actuator, strut, or link. 
With such a configuration sufficient information may be available to, instantaneously and 
without the need for integrating, measure position, velocity and acceleration. 

10 In accordance with a further aspect of the invention, a hexapod may be used as a 

manipulation stage in conjunction with conventional construction equipment 

In accordance with a further aspect of the invention, a hexapod may be configured 
as an extension of a standard implement adaptor, using male and female adaptors at its 
respective base and slave platforms. 

15 In accordance with a further aspect of the invention, a multi-axis, hexapod for 

example, equipment adaptor may be fitted with a motion control module powered by a 
conventional single circuit hydraulic supply or other power source. The motion control 
module may incorporate a hydraulically driven generator for powering servo valves, 
electric actuators, or other associated electronic devices. Control signals are preferably 

20 transmitted wirelessly between a joystick such as herein disclosed, to the adaptor, 
possibly through computers located at either or both ends of the signal transmission path. 
In accordance with a further aspect of the invention, the required sensors, which may be 
MEMS acceleration or angular rate sensors, are connected wirelessly, by a wireless 
network for example. 

25 In accordance with a further aspect of this invention, sensors at discrete points, 

such as MEMS acceleration and angular rate sensors, may be supplemented by angular 
position sensors, linear position sensors, and the like. 

In accordance with a further aspect of the invention, machine vision based sensing 
may be used separately or in conjunction with the aforementioned sensors at discrete 

30 points. Such a configuration may permit high accuracy while eliminating the need for 

highly precise mechanisms and expensive absolute positions encoders. Machine vision 

control of motion may utilize high resolution optics with limited fields of view within 

portions of the motion envelope where high local accuracy is required, in combination 

with lower accuracy wide angle vision equipment for coordinate transformation. 
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Geometry for coordinate transformation purposes may be provided by or supplemented 
by, the aforementioned MEMS accelerometers and angular rate sensors at discrete points, 
or conventional angle and displacement sensors. 

In accordance with a further aspect of the invention, machine vision may be used 
5 to determine the posture of a controlled machine for the purpose of aligning in real time 
the coordinate systems of a joystick with the coordinate system of the device being 
controlled. 

According to a further aspect of the invention, machine vision systems may be 
used to simultaneously to provide images to the operator for remote control while also 

10 providing machine interpreted information for real time adaptation of coordinate 
transformations between the joystick and controlled device. One or more machine vision 
systems may be used to simultaneously provide video information to both a human 
operator and a coordinate transformation controller. 

In accordance with another aspect of the invention, coordinate transforms may 

15 allow control to be relative to any particular desired point within the slave moving 
platform coordinate system or other coordinate system such as that of a fixed work piece 
or an element of a construction project. Examples of specific points that would make 
useful temporary slave platform coordinate origins may include; the tip of an auger or 
drill, center point between fork tips, a bolt hole pattern at the end of a steel beam, an 

20 object being tracked or observed by a camera, an object of interest such as an area of 
interest within CAT scan data set or computer model, and the like. Slave platform motion 
may be controlled relative to any one of various "fixed" coordinate systems such as the 
portion of the equipment such as a loader or forklift to which the multi-axis or hexapod 
manipulator may be attached, the operator of the equipment, or even the fixed frame or 

25 ground on which the equipment is supported. 

In accordance with a further aspect of the invention, machine vision detection of 
the operators eye(s) may be used to allow the operator to designate from time to time new 
coordinate origins, coordinate orientations, or motion constraints. Such an eye 
designation scheme might allow the operator of a multi-axis manipulator to designate that 

30 one end of a structural girder, for example, remain constrained while the other end is 

aligned for bolting under joystick control. This may allow an operator to concentrate on 

bolt hole alignment without concern for doing damage with the other end of the girder. 

In accordance with another aspect of the invention, movement of the slave 

platform along selected axis may be selectively constrained. By temporarily constraining 
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movement from 6 to fewer degrees of freedom using application-specific constraints, 
greater accuracy and utility can be achieved. This may be important in industrial 
applications such as drilling where the alignment (tip location and drill orientation) is 
chosen with 5-axis or 6-axis control, after which the drill axis is fixed during drilling, or 
5 forklift operation where the fork position and alignment might be best accomplished with 
6-axis control, but a direct-forward followed by a direct-upward movement is desired for 
lifting a load. 

In accordance with a further aspect of the invention, a touch screen graphic 
representation of the controlled equipment or payload may be used by the operator to 

1 0 graphically select the origin and/or orientation of the coordinate system. 

In accordance with another aspect of the invention, an operator of a robotic 
manipulator may be able to designate the end of a structural beam, for example, as an axis 
origin by three times placing said end of said beam at tihe same location but with three 
different beam axis orientations. 

1 5 According to another aspect of the invention, an operator may select the origins of 

the x, y, and z axis in any of the input device coordinate systems, the slave platform 
coordinate system, or computer model coordinate system to be offset by specified 
distances, i.e., to be non-intersecting and to be inclined by specified angles, i.e., not 
normal. 

20 In accordance with a further aspect of the invention, in order to accurately 

calculate fixed-frame coordinates, a slave platform mounted tilt sensor may be used to 
directly measure 2 axes of rotation between the tool and gravitational coordinates. 
Alternatively, slave platform mounted sensors such as laser distances gauges may be used 
to determine the orientation of a flat surface for the purpose, for example, of orienting a 

25 drill bit normal to said surface. 

In accordance with a further aspect of this invention, software code may be used 
to compensate for any unintended coupling, due to coil spring asymmetry, of the 
translational axis and rotational axis, which are coaxial with a coil spring type restoring 
element. 

30 Various additional embodiments of this invention that may enhance its usefulness 

or contribute to its ease of use are described as follows: 

One embodiment of the present invention may provide for a multi-axis joystick, 

the base of which may be gripped within the palm of the operator's hand and held by the 

ring finger and little finger, while the active grip of which may be manipulated by the ■ 
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operator's thumb, forefinger and middle finger. Such a configuration may allow freedom 
of wrist and arm movements while walking, presenting information to others, or 
performing construction tasks, for example. 

In accordance with a further aspect of the present invention, a conventional 
5 computer mouse may serve as the base to which a six axis input device of this invention 
may be mounted. In such a configuration, the base portion may be controlled by the 
user's hand or palm and may serve as a conventional computer mouse providing, for 
example, two degrees of freedom, while an appended multi-axis input device provides an 
additional six degree of freedom and may be independently controlled, for example, by 

1 0 means of the user's thumb, forefinger and middle finger. Such a configuration may, for 
example, provide 8 degrees of freedom. 

In accordance with a further aspect of this invention, a computer mouse may be 
equipped with an additional, optical for example, transducer located at a point offset from 
the location of the conventional x and y axis mouse movement transducers, thus 

1 5 providing an additional mouse axis sensitive to differential movements between the offset 
transducers or rotational movements about a vertical axis of the mouse as a whole. In this 
manner twist movements may be used to generate an additional, or third for example, 
output axis. Such a configuration may, for example, provide nine degrees of freedom. A 
twisting motion about a vertical axis may be more ergonomically accomplished with a 

20 mouse with a "pistol" or "gaming joystick" grip, the use of which vertically aligns the 
wrist end of the user's Rradia and Ulna bones. The user's wrist may be rotated 
approximately 90 degrees in such an orientation compared to perhaps 30 degrees when 
the users hand grips a conventional mouse. The "pistol" or "gaming joystick" grip has 
the further advantage in this embodiment that it may also be secured against the user's 

25 palm with the little finger and ring finger, leaving the users thumb, index finger, and 
middle finger free to actuate buttons and/or an appended (small) joystick. Such a grip 
may be optimized for comfortable and secure gripping using only the little finger and ring 
finger against the user's palm. The several transducer means of this invention may be 
more suitable than those of the prior art for construction a joystick sufficiently small for 

30 operation using the index finger, middle finger, and thumb only and sufficiently small for 
attachment to a first joystick or mouse. Some of the prior art joystick designs which 
might allow a desirably large range of motion may be particularly difficult to miniaturize 
in robust form.. 
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In accordance with a further aspect of this invention, the thumb operated 
transducers as described in Patent Application Publication No. US2002/0 104957 Al may 
be provided at several locations offset from each other in order to provide additional 
degrees of freedom. 

5 In accordance with a further aspect of tins invention the three degrees of freedom 

associated with a three axis mouse, such as the one herein described or one with a scroll 
wheel, might be used to provide 3 degrees of freedom for picking elements within a solid 
computer aided design model, while the attached multi-axis device might then provide an 
additional 6 degrees of freedom which might be used to manipulate the elements selected 

10 by means of the first three axis. 

In accordance with a further aspect of the invention, a finger and thumb operated 
six degree of freedom device may be mounted to a palm held six degree of freedom input 
device to provide simultaneous 12 axis control with only one hand. Such a combination 
might be used for example to control a supporting vehicle while also controlling a 

1 5 manipulator arm. Using such devices with both hands could provide simultaneous 24 
axis control. 

In accordance with a further aspect of the invention, a finger operated six degree 
of freedom input device may be appended to any number of otherwise conventional 
control means such as flight control sticks, flight control yokes, steering wheels, rudder 
20 wheels, joysticks, control levers, control pendants, and the like. 

Such schemes may be useful for controlling a multi-axis manipulators or tools 
which may be attached to bases or vehicles which may require or benefit from concurrent 
multi-axis control. 

Yet another embodiment of the present invention may be in the form of a mouth, 

25 jaw, or head operated controller for use by quadriplegics, an application for which the 

prior art designs may be too bulky. 

In accordance with another aspect of the invention, the entire device may be hand 

held and portable and the active grip may be manipulated with respect to a base portion 

which may remain fixed relative to the user's grasped hand or fingers, thus allowing the 

30 device to be held and used with only one hand. Alternatively, a portion of the base may 

be secured to the user's wrist or palm such as by strap or glove means. Signal 

transmission for such hand held configurations may even be preferably by wireless 

means. The coordinate system for such a hand held configuration may be relative to the 

fixed portion of the device within the user's hand or relative to external coordinates 
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determined by some combination of criteria such as radio signals, laser signals, gyro 
signals, magnetic orientation and gravitational orientation. Such portable embodiments 
may incorporate other devices such as orientation sensors, accelerometers, gyroscopes, 
etc. 

5 In accordance with a further aspect of the invention, wrist or forearm mounting of 

the above described "hand held" configuration may allow for the incorporation of a hinge 
for temporarily swinging the active grip out of the way of the operator's hand. 

In accordance with yet another aspect of the invention, a six-axis sensor assembly 
may be situated between two handles, such that the relative motion of the two handles 

1 0 may generate a corresponding signal. The handles may, for example, be the two halves of 
a two handed game console similar to those used in conjunction with the Sony 
Playstation® or the Microsoft X-box®. 

In accordance with another aspect of the invention, the device may be of 
sufficiently small size to be incorporated into a computer keyboard, into a hand held 

1 5 computer, or into another control handle or device, and the like. 

A joystick for operation of construction equipment could be able to be operated 
with large deliberate hand motions while wearing insulated winter gloves, for example. 
In such circumstances, a finger operated fine-range-of-motion joystick may not be 
practical due to overwhelming vibrations and machinery movements as well as lack of 

20 fine finger tip tactile feedback. Accordingly, several aspects and embodiments of this 
invention may address a need for a larger range of motion as follows: 

In accordance with one aspect of the invention, the active grip may be provided 
with an enhanced range of movement by means of one or more flexible elements to which 
the sensor base may be attached. 

25 In accordance with a further aspect of the invention, flexible elements may be 

configured to minimize any unintended coupling between axes. This may be 
accomplished for example by fixing the base of a limited range of motion multi-axis 
joystick (of either this invention, prior art or future art) to a first mounting block to which 
the upper ends of 3 or more flexible and generally parallel rods are fixed. The lower end 

30 of the flexible rods may be fixed to a second mounting block. The first and second 

mounting blocks will tend to remain parallel despite deflections in a horizontal plane. In 

other words, horizontal translational flexibility is thus provided without unintended and 

undesirable coupling to the horizontal rotational axes. The second mounting block may 

be mounted on a pair of offset but generally parallel leaf springs. The other end of the 
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generally parallel leaf springs may be fixed relative to the operator. The leaf spring 
assembly provides torsional stiffness in all three axes while permitting significant z-axis 
motion of the joystick grip. 

In accordance with a further aspect of the invention, a transducer means and other 
5 moving parts may be protected from damage and contamination by a flexible bellows. 

In accordance with a further aspect of the invention the bellows may be designed 
to exhibit significant torsional compliance about the bellows axis of symmetry, which is 
generally not the case with conventional bellows. Such torsional compliance may be 
provided by convolutions of alternating orthogonal orientation, for example. 

10 In accordance with a further aspect of this invention, a second bellows may be 

provided, either connected or not connected to the moving mechanism, for the purpose of 
equalizing pressure within a bellows protected cavity. This aspect may be particularly 
important for facilitating Z-axis movement without causing pressure differences or 
contamination due to otherwise required ventilation. 

15 In accordance with another aspect of the invention, a wrist rest may be provided 

which is movable with and associated with the active grip but which may support gravity 
and acceleration loads of the user's arm separately from the active grip. In this manner, 
the user's arm may be desirably supported to reduce fatigue, while allowing large range 
joystick movements, which may be desirable in high vibration environments such as 

20 operation of construction equipment Measurement of the instantaneous weight of the 
user's arm may be accomplished by means of separate load cell(s) associated with the 
wrist rest, for example. 

Various additional modifications and improvements which may increase the 
usefulness of this invention are described as follows: 

25 In accordance with a further aspect of the invention, a multi-axis transducer in 

accordance with the present invention may be affixed to an otherwise conventional 
Stewart platform or equivalent such that said multi-axis transducer may generate an 
operator originated force/displacement signal while the underlying Stewart Platform or 
equivalent supplies force and position feedback to the operator. Such an arrangement 

30 may also be used to provide increased displacements compared to those provided by the 

multi-axis transducer itself. 

In accordance with another aspect of this invention, fiber optic guides may be 

used to emit and receive light within the transducer assembly, for example, which may 

eliminate electrical power components from the transducer vicinity for uses such as 
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controlling a bucket truck boom or robotic arm used to service high voltage power lines, 
and the like. A fiber optic connected version of the present invention could also be useful 
for construction of an extremely small multi-axis position transducer which could be 
applicable to miniature robotics, the manufacturing of small scale electrical and 
5 mechanical devices, as well as to micro biology and medical applications and the like. 

In accordance with another aspect of the invention, the transducer element of this 
invention may be used as a six-a^is accelerometer or motion sensor by attaching a 
reference mass to the movable mirror assembly. 

In accordance with another aspect of the invention, the displacement transducer 
10 element of this invention may be used as a general-purpose multi-axis displacement 
measuring means. 

In accordance with a further aspect of the invention, a noise-canceling element 
may be provided to reduce noise from ambient vibrations. For example, accelerometers 
mounted to the base of the device may be used to cancel out spurious signals such as 

1 5 those caused by vehicle vibrations. 

Various aspects of this invention may be utilized in order to reduce in cost and 
make more compact embodiments of the prior art. For example, the use of mirror 
elements of this invention in conjunction with the light transducer circuitry and shading 
means of Hilton et al. may facilitate the use of a single circuit board or monolithic photo 

20 transducer. In this example, the mirrors could be stationary and the shading means may 
be movable or the shading means could be movable and the mirrors stationary. 
Alternatively, fiber optic or light guide elements) could be used instead of mirrors in 
order to reverse the direction of the light paths or to distribute the light from a single 
source to light paths of suitable orientation and geometry. 

25 A further embodiment may incorporate a plurality (six, for example) of magnetic 

flux sensors such as Hall Effect transducers or Giant Magnetic Effect (GME) transducers 
onto a single printed circuit board which may be movable in multiple degrees of freedom, 
six for example, relative to a magnetic flux structure which may be established by a single 
magnet for example. Said embodiment may shield the magnetic flux sensors from 

30 ambient magnetic fields by means of a flux conducting magnetic grip or portion thereof, 

which may provide a flux path (for externally imposed magnetic fields) around the 

magnetic flux sensors along any required direction. A ferromagnetic pole piece, for 

example, may be used to direct magnetic flux in a maimer which establishes easily 

measured magnetic flux gradients at the magnetic flux sensors, thus rendering detectable 
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displacement of the flux paths relative to the detectors. The flux may, for example, be 
directed along three paths with each magnetic flux path intercepting two magnetic flux 
detectors. The magnetic flux sensors may be located and oriented relative to the flux 
paths such that the motion sensitive axis, i.e., the direction in which the derivative of the 
5 cross products of magnetic flux and the axis of maximum magnetic flux detector 
sensitivity with respect to displacement are maximum. 

Alternatively, magnetic flux gradient detectors, such as MEMS devices 
incorporating microscopic magnets on force transducers may be used in a similar manner 
wherein the second derivative of flux density would be oriented and optimized relative to 
1 0 sensor sensitive axis orientation. 

According to yet another aspect of the invention, line frequency noise could be 
electronically filtered from the output signal. 

According to a further aspect of the invention, additional looped circuit paths with 
or without separate resistors could be provided in the circuit board to provide magnetic 
1 5 damping of the spring suspended assembly. Such damping may be helpful in a vibration 
prone environment such as in construction equipment control applications. 

A further embodiment may utilize an elastomeric or elastic structure to measure 
deflections of an active grip, for example. In a simpler form, such an embodiment may be 
comprised of a single conductive elastomeric structure and associated electrical terminals 
20 attached thereto. The conductive elastomer may preferably be ionically conductive, 
which properly results, in a smooth and useful strain-resistance curve in contrast, to 
conductive particle filled elastomers which may exhibit less useful strain-resistance 
characteristics. 

According to a further aspect of the invention, a single piece of conductive 
25 elastomer may be configured in the shape of a Stewart Platform or its functional 
equivalent. 

According to a further aspect of the invention, multiple segments of conductive 
elastomer may be configured in the general shape of a Stewart Platform or its functional 
equivalent. 

30 Alternatively, a deformable structure of conventional (likely non-conductive) 

elastomer may be used to contain a dielectric fluid or conductive fluid such as an 

electrolyte solution. Said dielectric fluid or conductive fluid may cause the electrical 

relationship between a plurality of electrodes immersed therein to vary as the shape of the 

cavity or cavities in which said fluid is contained changes shape with deformation of said 
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deformable structure. In the case of either of the aforementioned elastomeric structures, 
the gauge factor may be much higher than for conventional strain gauges due to the 
generally higher elongation of elastomers compared to metal or semiconductor strain 
gauge materials. 

5 According to a further aspect of the invention a single cavity within an 

elastomeric structure containing a conductive or dielectric fluid may be configured in the 
shape of a Stewart Platform or its functional equivalent The walls of such a cavity are 
preferably convoluted along several orthogonal directions to allow deformation in six 
degrees of freedom and relatively uniform stifBaess amoung the various axes. 

10 According to a further aspect of the invention, multiple cavities containing 

conductive or dielectric fluid may be configured in the shape of a Stewart Platform or its 
functional equivalent 

According to a further aspect of the invention, a deformable elastomeric structure 
may be provided that may be configured for attachment of a plurality of single axis 

1 5 displacement transducers. Such a structure may be very inexpensive and may facilitate 
simple zero-backlash mounting of inexpensive displacement transducers. 

According to a further aspect of the invention, a plurality of cavities may be 
provided in the configuration of a Stewart Platform or its functional equivalent, wherein 
said cavities may be connected to pressure transducer means. 

20 According to a further aspect of the invention, a plurality of stiffeners are 

provided within an elastomeric structure, wherein said stiffeners transmit strains to 
transducer means such as MEMS devices or strain gages. Said stiffeners may be 
configured in the general configuration of a Stewart Platform or it functional equivalent. 

According to a further aspect of the invention, various ergonomic arrangements of 

25 the present invention may be utilized in conjunction with video or other non-contact 
position sensing means instead of by way of the sensor means disclosed herein. For 
example, the 12 axis joystick of Figures 35a through 35g could be used to provide a 
consistent interface for the operators), while measurement of the active grip positions 
and/or hand positions may be accomplished by one or more video cameras, for example. 

30 Such an arrangement may be superior for some applications to schemes for interpreting 

completely free form hand gestures by way of video measurement 

According to a further aspect of the invention, multiple actuatable sensor stages 

such as those comprised of multiple inflatable cavities or actuators may be mounted in 

series to create a snake-like robotic device with many degrees of freedom. 
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Many of the above multi-axis joysticks produce, for example, six analog signals 
which may need to be nonlinearly transformed to position and rotation deflections with 
respect to the x, y, and z axes. Many alternative methods and algorithms may be used to 
derive from the transducers of a multi-axis joystick a signal of desired usefulness. The 
5 following is but one example of a general method of deriving a useful signal. 



The transformation may be multi-stage, and may consist primarily of a linear 
diagonalization and a nonlinear scaling and correction. A cubic polynomial 
transformation may be used to model the nonlinear mapping from signals to outputs. A 

1 0 full cubic polynomial with six input variables has 6*4 A 6 = 24576 coefficients, and may be 
too computationally costly to be useful. A better transformation may consist of an 
approximate linear transformation to achieve nearly diagonal outputs followed by a 
polynomial transformation with all terms up to total 3rd order (e.g., (1, x, y, x A 2, x*y, 
y A 2, x A 3, x A 2*y, x*y A 2, y A 3) for 2 variables). This requires 6*6 = 36 coefficients for the 

1 5 linear diagonalization transform and 504 coefficients for the nonlinear cubic part, which 
may be computationally feasible. An initial pre-transform using 6 coefficients might be 
done on each production unit to account for manufacturing variations in the individual 
sensors. A final post-transformation which rescales the translation, rescales the rotation, 
and centers the output (tares) requires 1+1+6 = 8 coefficients, might be specified per user 

20 preference. 

For any particular prototype design, the 36 pre-transform coefficients and 504 
nonlinear transform coefficients might be calculated as follows: Each axis may be 
sampled at positive, zero, and negative locations in a 6-cube grid, yielding 3 A 6 = 729 
sample points (e.g., center, forward, forward and up, forward and left-twist and nose- 

25 down-twist, etc.) at center and extreme positions. The 36 linear transform coefficients 
may be fit with a least-squares solution to best diagonalize the output Using these 
coefficients, the sample data may be linearly transformed to produce an approximately 
linear data set Then the 504 nonlinear transformation coefficients may be fit, again 
using, for example, a linear least squares solution. 

30 Once a design prototype has been calibrated, each production unit might use the 

same 36 linear transform coefficients and the same 504 nonlinear transform coefficients, 

but a one-time calibration of the 6 sensor scaling coefficients might be done at first use, 

or possibly before sale. Each user might specify, for example, a single translation 

sensitivity coefficient and a single rotation sensitivity coefficient to suit preference. At 
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the time of initial use and possibly throughout each use of the device, the output might be 
centered (tared) using 6 coefficients to account for minor variations in temperature, 
orientation, or the user's hand weight, etc. 

5 IV. Brief Description of the Drawings 

Figures 1 a through le all depict various views generated from a SolidWorks® solid 
model of one of the preferred embodiments of a six axis joystick constructed according to 
this invention. 

1 0 Figure la is a plan view looking down the Z-axis of said six-axis joystick with example 
light paths depicted. 

Fig. lb is a sectional cutaway elevation view showing the major components of said 
joystick- 
Fig, lc is a cutaway perspective view showing the major components of said joystick. 
1 5 Fig. Id is an elevation view of said joystick. 

Fig. le is an exploded view depicting the salient components of said joystick. 

Fig. 2 is a perspective view of the active grip of said joystick depicting the internal 

reflective facets. 

Fig. 3 is a schematic of a cylindrical projection of a six-axis joystick in accordance with 
20 the present invention in conjunction with one type of associated electrical schematic. 

Fig. 4 is a schematic of a cylindrical projection of a six-axis joystick in accordance with 

the present invention with illustrating the function of curved mirror facets. 

Fig. 5 is a schematic of a cylindrical projection of an embodiment of the present invention 

shown in conjunction with a corresponding electrical schematic illustrating the 
25 implementation of touch sensing means and truncated mirror facets. 

Fig. 6 is a perspective view of integrated photo emitter/photo detector package in 

accordance with one embodiment of the present invention. 

Fig. 7 is a schematic of a cylindrical projection of another embodiment of a six-axis 
joystick in conjunction with a corresponding electrical schematic. 
30 Figures 8a through 8e all depict various views generated from a SolidWorks® solid 
model of another of the preferred embodiments of a six axis joystick constructed 
according to this invention. 

Figure 8a is a plan view looking down the Z-axis of said six-axis joystick with example 
light paths depicted. 
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Fig. 8b is a sectional elevation view showing the major components of said joystick. 
Fig. 8c is a cutaway perspective view of said joystick. 
Fig. 8d is an elevation view of said joystick. 

Fig. 8e is an exploded view depicting some salient components of said joystick. 
5 Fig. 9 is a perspective view of the active grip of said joystick depicting the internal 
reflective facets. 

Fig. 10a is a cross section view of an embodiment of the present invention featuring a 

traditional "joystick" style active grip, an enhanced range of motion, and protective and 

pressure compensating bellows. 
1 0 Fig. 10b is an additional cross section view of the embodiment of Fig. 10a. 

Figures 11a, lib, 11c and lid are plan, cross-sectional, perspective, and exploded views 

respectively of an example magnetic flux sensor embodiment of the present invention. 

Fig. 12 is a plan view of a magnetic element of an embodiment of the present invention. 

Fig. 13 is a plan view of an assembled magnetic element of an embodiment of the present 
1 5 invention. 

Fig. 13a is a cross-sectional elevation view of a magnetic embodiment of the present 
invention. 

Fig. 14 is a printed circuit board detail of an embodiment of the present invention. 
Fig. 1 5a is a sectional view of an elastomeric embodiment of the present invention. 
20 Fig. 1 5b is an exploded view of the embodiment of Fig. 1 5a. 

Fig. 15c is another exploded view of the embodiment of Fig. 15a 
Fig. 1 5d is an elevation view of the embodiment of Fig. 1 5a. 
Fig. 15e is sectional view similar to Fig. 15a. 

Fig. 16 is a sectional elevation view of another elastomeric embodiment of the present 
25 invention. 

Fig. 17 is a representative equivalent circuit of an elastomeric embodiment of the present 
invention. 

Fig. 18a is an elevation view of the sensor portion of yet another elastomeric embodiment 
of the present invention. 
30 Fig. 1 8b is another elevation view of the sensor element depicted in Fig. 1 8a. 
Fig. 1 8c is a plan view of the sensor element depicted in Fig. 1 8a, 
Fig. 1 8d is a perspective view of the sensor element depicted in Fig. 1 8a. 
Fig. 1 8e is a representative equivalent circuit of the sensor element depicted in Fig. 18a. 
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Figures 19a, 19b, 19c, and 19d are respectively, a perspective view, an elevation view, 
another elevation view, and a plan view of a sensor assembly in accordance with yet 
another elastomeric embodiment of the present invention. 

Fig. 19e is a representative equivalent circuit of the sensor assembly of the elastomeric 
5 embodiment of the present invention as it is depicted in Figures 19a, 19b, 19c, and 19d. 
Figures 20a and 20b are plan view and sectional elevation view of one of several 
electrolyte filled elastomeric embodiments of the present invention. 

Figures 21a, 21d,21e, and 21f are, respectively, a plan view, an elevation view, another 
elevation view, and a perspective view of an assembly of another electrolyte filled 
1 0 elastomeric embodiment of the present invention. 

Fig. 21b is a view of a single transducer subassembly of the transducer assembly depicted 

in Figures 21a, 21d, 21e, and 21f 

Fig. 21c is section A-A taken through Fig. 21b. 

Fig. 22 is a sectional schematic cut along a hexagonal of path yet another electrolyte filled 
1 5 elastomeric embodiment of the present invention shown during representative stages of 
manufacture and assembly. 

Fig. 23 is a partial sectional schematic cut along a hexagonal path of yet another 
electrolyte filled elastomeric embodiment of the present invention. 

Fig. 24 is a partial sectional schematic cut along a hexagonal path of yet another 
20 electrolyte filled elastomeric embodiment of the present invention. 

Fig. 25a is an elevation view of an elastomeric embodiment of the present invention 
utilizing a combination of stiffening elements and force sensors. 

Fig. 25b is an elevation view of another elastomeric embodiment of the present invention 
utilizing a combination of stiffening elements and force sensors. 
25 Fig. 25c is a plan view depicting one of many possible stiffener arrangements. 

Fig. 26 is a partial sectional view showing one element of the multi-axis sensor portion of 
an elastomeric embodiment of the present invention utilizing a combination of stiffening 
means and pressure sensing means. 

Fig. 27 is a sectional view of an embodiment of the present invention depicting the use of 
30 discrete single axis displacement sensors in conjunction with a deformable elastomeric 
structure. 

Fig. 28 is a representative partial sectional view of another embodiment of the present 
invention depicting the use of discrete single axis displacement sensors in conjunction 
with a deformable elastomeric structure. 
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Fig. 29 is a representative partial sectional view of yet another embodiment of the present 
invention depicting the use of discrete single axis displacement sensors in conjunction 
with a defonnable elastomeric structure. 

Fig. 30 is a representative partial sectional view of the sensor portion of yet another 
5 embodiment of the present invention depicting the use of extendable coiled variable 
inductors embedded within a defonnable elastomeric structure. 

Fig. 31 is a representative partial sectional view of the sensor portion of yet another 
embodiment of the present invention depicting the use of extendable coiled variable 
inductors embedded within a defonnable elastomeric structure in conjunction with a 
1 0 plurality of cavities which may be deformed by internal pressure for force or position 
feedback purposes. 

Figures 32a, 32b, 32c, and 32d are, respectively, sectional elevation, partial plan, partial 
sectional elevation, and perspective views of an embodiment of the present invention 
featuring an electrolyte filled deformable sensor, a gel filled wrist rest and an integral data 
1 5 entry keypad. 

Fig. 33 is a schematic representation of an embodiment of the present invention 
comprising a two handed game controller with a multi-axis sensor means connecting the 
right and left gripped portions of said game controller. 

Fig. 34 is a schematic illustration of a hand held embodiment of the present invention. 

20 Figures 35a, 35b, 35c, 35d, 35e, 35f, 35g, and 35h are photographs of a model of an 
embodiment of the present invention comprising a finger tip operated active grip of 
approximately 1.5 inch diameter, with six degrees of freedom for example, mounted to a 
hand held active grip, with an additional six degrees of freedom, for example. 
Figures 36a and 36b are photographs of a model of an embodiment of the present 

25 invention similar to that shown in Figures 35a through 35h, except with a finger-tip 
operated grip of approximately 1 inch diameter. 

Figures 37a and 37b are photographs of an embodiment of the present invention wherein 
a fingertip active grip is mounted to a fixed hand stabilizing grip wherein said fingertip 
operated active grip is an approximately 1 .5 inch diameter sphere. 
30 Figures 38a, 38b, 38c, and 38d are photographs of a model of an embodiment of the 
present invention similar to that shown in Figures 37a and 37b, except that the fingertip 
operated grip is a sphere of approximately 1 inch diameter. 

Fig. 39 is an electrical schematic of a bridge circuit corresponding to an elastomeric 
embodiment of the present invention. 
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Fig. 40a is a perspective view of an elastomeric sensing element in accordance with one 
of the embodiments of this invention. 

Fig. 40b is a cross sectional view of the sensing element of Fig. 40a. 

Fig. 41 is an elevation view of an embodiment of the present invention that incorporates a 
5 plurality of electrically conductive elastomeric tensile members. 

Fig. 42 is a representative electrical schematic of one embodiment of the present 
invention. 

Fig. 43 is a representative electrical schematic of another embodiment of the present 
invention. 

1 0 Fig. 44 is a schematic of an electrolyte filled cavity of Stewart Platform geometry within 
a deformable elastomeric sensing element in accordance with one embodiment of the 
present invention. 

Fig. 45 is an electrical schematic corresponding to the embodiment of Fig. 45. 
Fig. 46 is a cross section of one embodiment of the present invention. 
1 5 Fig. 47 is an illustration of one exemplary relationship between a three phase excitation 
signal and an output signal from one embodiment of the present invention. 
Fig. 48 is a view of a printed circuit board arrangement which might be used in 
conjunction with the embodiment of Fig. 46. 

Fig. 49a is a plan view of aone embodiment of the present invention wherein a base 
20 portion of a six axis joystick is stabilized by a gel pad wrist rest. 

Fig. 49b is a sectional elevation view of the embodiment shown in Fig. 49a 
Fig. 49c is an exploded view of the embodiment shown in Fig. 49a. 
Fig. 49d is a perspective view of a portion of Fig. 49a. 

Fig. 50a is a cutaway view of one embodiment of the present invention featuring a 
25 monolithic optical position transducer. 

Fig. 50b is an exploded view of the embodiment of Fig. 50a. 

Fig. 50c is a perspective view of the monolithic position transducer from Fig. 50b. 

Fig. 51a is a perspective view of a finger operable joystick appended to a three axis 

mouse. 

30 Fig 5 lb is a bottom view of the embodiment of Fig. 51a. 

Fig. 51c is an end view of the embodiment of Fig. 51a. 

Fig. 5 Id is a side view of the embodiment of Fig. 51a. 

Fig. 51e is a top view of the embodiment of Fig. 51a. 

Fig. 51f and Fig. 51g are perspective views of the embodiment of Fig. 51a. 
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Fig. 52 is a perspective view of an embodiment of the present invention including a 
loader equipped with sensors to facilitate coordinate transformation for control of a 
Stewart platform adaptor using a joystick. 

5 Fig. 53 is a schematic diagram of an example control scheme for the embodiment of Fig. 
52. 

Fig. 54a is a cross section of a monolithic transducer. 

Fig. 54b is a partial edge view of the embodiment of Fig. 54a 

Fig. 55 is a sectional elevation of a joystick in accordance with one aspect of this 
1 0 invention. 

Fig 56a is a cross section of a joystick in accordance with one embodiment of this 
invention including two coaxial springs placed symmetrically with respect to the 
transducing element 
Fig. 56b is an example reflective pattern. 
1 5 Fig. 56c is an example reflective pattern. 

Fig. 57 is a schematic depicting an example null state' angular and axial alignment of 
transducer and reflective pattern. 

Fig. 58 is an example stress analyses of a spring used in one aspect of this invention. 
Fig. 59 is another example of a stress analyses of a spring used in one aspect of this 
20 invention. 

Fig. 60 is an example of a spring with a single elastic element in accordance with one 
aspect of this invention. 

Figures 61a and 61b are simulated images incident on the transducer of one embodiment 
of this invention. 

25 

V. Modes For Carrying Out the Invention 

A multi-axis input transducer apparatus may comprise an at least quinary input element 

capable of input with respect to at least five frames of reference, a reflective element 

30 responsive to radiation from a source capable of emitting radiation eventually incident 

upon said reflective element and at least one reflected radiation detector responsive to 

radiation from said reflective element. The term reflection is used broadly to include 

refraction of said radiation. Referring to Figures la (plan view), lb (sectional elevation 

view), lc (cutaway perspective view), Id (elevation view), and le (exploded view), a 
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preferred embodiment of a six-axis joystick in accordance with the present invention is 
shown. Active grip 1 may incorporate reflective facets 2a, 2b, 2c, 2d, 2e, and 2f. Said 
reflective facets or reflector may be aligned such that each reflects the light from light 
source or radiation source 4 (which may be a light emitting diode) to a photo detection 
5 element or other reflected radiation sensor at one particular location. Said photo detection 
element may be photodiodes, phototransistors, photo resistors, or other suitable light 
detection means, or fiber optic ports leading to such detection means at another location 
such as on an ASIC (application specific integrated circuit chip). Active grip 1 may be 
held in position by a restoration element such as coil spring 10, which may be angularly 

1 0 located in the active grip by recess 1 1 and in the base 3 by recess 12. A means such as a 
light baffle 6 may be used to prevent direct illumination of detector(s) 5a, 5b, 5c, 5d, 5e 
and 5f by light source 4. Said light baffle 6 may also be configured to assist in locating 
and orienting said light source 4 and perhaps photo detectors 5a, 5b, 5c, 5d, 5e and 5f 
during soldering, for example. Said baffle 6 may be used to retain printed circuit board 

15 13 by means of screws 7. Some retaining means such as screws 8 or pins may be 
provided to limit the travel of the active grip perhaps so that maximum travel of active 
grip 1 remains within the measurement range of the optical elements such as photo 
detectors 5a, 5b, 5c, 5d, 5e, and 5f in conjunction with reflector element(s) within active 
grip 1 and light source 4, and perhaps so that said maximum travel remains within the 

20 elastic range of restoring means such as spring 10, and within the various mechanical 
clearances between the movable and stationary components. The contact characteristics 
between said retaining means 8 and associated receptacles 9 may be optimized by friction 
reduction element and/or energy absorption element such as coatings or bushings. 
Referring to Figures la and Id, light paths 14 may no not lie in radial planes but instead 

25 may follow paths, which may be controlled, by the locations and orientations of the 
various mirror facets. By means of this arrangement, the lengths and alignments of the 
light path to the 6 photo detectors may uniquely define the position of the active grip in 
the x, y, z, ©x, ©y, and 0z degrees of freedom. In general the brightness may also vary 
as the inverse square of the effective light path distance. The sensitivity of brightness 

30 with respect to mirror facet position may be maximum for movements of any mirror facet 

along an axis normal to the surface of said mirror facet Said axes normal to said mirror 

facets may comprise a virtual octahedral hexapod or "Stewart Platform". Movements 

along either axis normal to the said first axis may have no effect on light path length ot 

brightness. Extreme movements could of course shift said mirror facet completely off of 
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said light path, but such extreme movements are not required and may be, in fact, 
prevented by mechanical stops. Angular movements about an axis normal to said mirror 
facet may have no effect on said light path. Angular movements about any axis lying in 
the plane of said mirror segment may simply cause a lateral shift in the point of reflection 
5 of said light path with only negligible second order effects on light path distance. 

Said effective light path distance corresponding to the null position of the active 
grip can be optimized as a design variable by means of lens elements associated with the 
light source, the photo detectors and/or by curvature of the reflective facets. For example, 
a virtual image of the light source may be created at a position closer than the distance 

1 0 corresponding to the physical light path in order to obtain a greater change in brightness 
for a given change in mirror facet movement Spatial distribution of illumination by the 
light source and spatial distribution of light sensitivity of the light detectors may also be 
adjusted by the use of lens elements. The changes in alignment of the emitters, mirrors, 
and detectors may also be used advantageously to generate photo detector signals that 

1 5 represent the mirror facet positions. If any particular light path from an emitter straddles 
an edge of a mirror or the edge of a detector assembly, any relative movement of said 
light path and said edge may create a significant change in measured light intensity. 

The aforementioned discussion of function and geometry may apply equally to a 
reversed embodiment wherein a single photo detector, which could in said embodiment 

20 be designated as item 4 in the various Fig. 1 views, sequentially measures light intensity 
from a plurality of light emitters 5a, 5b, 5c, 5d, 5e, and 5f in the Fig. 1 views. In said 
embodiment said light emitters may be cycled in a circular pattern for example, to enable 
individual light intensities and thereby light path distances to be measured. The use of a 
single photo detector may facilitate the use of a single channel analog to digital converter 

25 which could be time multiplexed in synchronism with illumination of the plurality of light 
emitters. 

Referring to Fig. 3, a cylindrical projection schematic is shown in conjunction 

with a schematic of one of many alternative possible electrical arrangements. The optical 

elements depicted in Fig. 3 may be the same as those depicted in Figures la, lb, lc, Id, 

30 and le. Photo detectors 5a, 5b, 5c, 5d, and 5e may be physically distributed as a 

hexagonal array around photo emitter 4, which is shown schematically on the right hand 

side of Fig. 3, but which may be located for schematic purposes directly behind each of 

said photo detectors. Mirror facet 2a may reflect light from photo emitter 4 onto photo 

detector 5b. Mirror facet 2b may reflect light from photo emitter 4 onto photo detector 
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5a. This pattern may be repeated for a total of six light paths, the lengths of which define 
the exact position and orientation of the active grip and its mirror facets in six degrees of 
freedom. Coil spring 10 (which physically supports active grip 1 shown schematically on 
the left hand side of Fig. 3) is shown electrically connected to grip 1 and touch detection 
5 circuit 15. Grip 1 may incorporate a separate capacitive touch switch element, if 
required, or may utilize the mirror coating such as that on mirror facet 2a to accomplish 
the capacitive touch switch function. "Active grip" is herein used to mean that portion of 
a multi-axial input device gripped and moved by the user relative to the user's frame of 
reference. The outputs of photo detectors 5a, 5b, 5c, 5d, 5e, and 5f are shown connected 
10 to amplifiers 18a, 18b, 18c, 18d, 18e and 18f and resistors 19a, 19b, 19c, 19d, 19e, and 
19f. The output of said amplifiers is shown connected to a programmable interface 
controller (PIC®) 16 from which device the signal(s) may go to a signal-receiving device 
17 such as a computer or robot. The axes of six degrees of freedom are labeled at the top 
of Fig. 3. 

1 5 Referring now to Fig. 4, while flat mirror facets are depicted in the figures la, lb, 

lc, Id, le, 2, and 3, the curved facets schematically illustrated in Fig. 4 may be used 
advantageously to obtain greater sensitivity and resolution for particular applications. 
Light 14 from emitter 4, which is hidden from direct view in Fig. 4, may be focused by 
mirror facet 2a to form an image of said emitter 4 at a distance L from photo detector 5b. 

20 For clarity, the light between emitter 4 and detector 5a is not shown in Fig. 4. 

Referring now to Fig. 5, mirror assembly and active grip 1 may incorporate 
truncated mirror facets 2a, 2b, 2c, 2d, 2e, and 2f. Light from emitter 4 may follow paths 
14 which may impinge of the edges of mirror facets 2a, 2b, 2c, 2d, 2e, and 2f. That light 
which strikes said mirror facets may reach photo detectors 5a, 5b, 5c, 5d, 5e and 5f. That 

25 portion of light which strikes light absorbent surface 41 may not reach said detectors. 
This arrangement is thus sensitive to the relative movement of the edges of mirror facets 
2a, 2b, 2c, 2d, 2e, and 2f. 

Referring now to Fig. 6, a monolithic photo transducer package is shown 
comprised of casing 44, photo detectors 42a, 42b, 42c, 42d, 42e, and 42f, photo emitter 

30 43, and electrical connection 45. Such a monolithic transducer may be more robust than 

printed circuit board mounted transducers and may thus not be subject to optical 

misalignment due to handling during manufacture or due to high g forces due to being 

dropped on the floor for example. The monolithic package may also be advantageously 

used to grind flush and thereby remove the collimating lenses that are standard as- 
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manufactured features of many discrete photo transducer components. Although not 
depicted in Fig. 6, such a monolithic package may also be configured to retain a spring 
used to support the active grip. 

Referring now to Fig. 7, detectors 46a, 46b, 46c, 46d, 46e, and 46f may be located 
5 such that light paths 14 straddle their edges. Any movement, due to movement of active 
grip 1, of light paths 14 normal to said edges may thus cause a change in brightness. 

Referring to Figures 8a (plan view), 8b (sectional elevation view), 8c (cutaway 
perspective view), 8d (elevation view), and 8e (exploded view), a preferred embodiment 
of a six-axis joystick in accordance with the present invention is shown. Active grip 

1 0 portion la, also shown by itself in Fig. 9, may incorporate reflective facets 2a, 2b, 2c, 2d, 
2e, and 2f. Active grip portion lc may retain active grip portion lb which has preferably 
a low durometer (<40 Shore A hardness) elastomer. Such a soft grip portion la may 
provide a non-slip surface which may be reliably engaged by the operator's fingertips 
with minimal gripping force. The compliance of the grip due to its low hardness in 

15 combination with significant thickness may reduce contact stresses on the operator's 
fingers and thus may help prevent reduction in blood circulation. Said grip portion lb 
may be a standard O-ring shape. Grip portion lc may feature holes in bottom portion. 
The outer holes may provide a predetermined amount of clearance to stand off spacers 21. 
The relative diameters of holes 22 (taking into account grommets if used) and spacers 21 

20 may define the range of motion in a horizontal plane of the active grip. Vertical 
clearances between grip portion lc and base 3 and between grip portion lc and circuit 
board 13 may provide a predetermined amount of vertical travel. The active grip 
assembly comprised of portions la, lb, and lc may be thus confined to a predetermined 
allowable extent of travel in six degrees of freedom. Active grip portion la may be fixed 

25 to spring 10 by spring retaining grooves 47 in active grip portion la. Spring 10 may in 
turn be fixed to monolithic transducer package 21 by groove 48. Said monolithic 
transducer package 21 may incorporate a circuit board 13 which may extend outward 
radially to engage spacers 21 and screws 23. Alternatively, an additional separate piece 
may be used for mounting transducer package 21 and engaging some mounting means 

30 such as spacers 21 and screws 23. 

Referring now to Figures 10a and 10b, an embodiment of the present invention 

featuring a traditional "joystick" style active grip, an enhanced range of motion, and 

protective and pressure compensating bellows is shown in cross section. Transducer 25 

may be similar to that described in Fig. 8a, 8b, 8c, 8d, and 8e. Said transducer may 
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necessarily have a limited range of motion especially if it is to be contained within active 
grip 24. The arrangement shown is intended to provide additional range of translational 
motion along three axes as follows: Leaf springs 29 and 30 are fixedly mounted to 
mounting block 28. Connection block 35, which may be nominally the same height as 
5 mounting block 28, can be deflected upward and downward along the Z-axis without 
motion about the ©x axis. Mounting block 36 may be attached to a plurality of beams 31, 
32, 33, and 34 that may be in turn attached to connection block 35. Moments of inertia 
about the Z-axis for beams 31, 32, 33, and 34 are selected to provide a predetermined 
degree of stiffness in torsion about the Z-axis. The spacing of beams 31, 32, 33, and 34 

10 may be nominally the same at both connection block 35 and at mounting block 36. 
Horizontal deflections of mounting block 36 may not therefore cause twisting of the 
active grip about the 0x or ©y axes. The nominal equal spacings of the flexible elements 
at the various mounting points may be adjusted to achieve controlled amounts of 
coupling, if desired, of the various rotational and translational axes. Bellows 26 may be 

1 5 similar to that used on conventional joysticks except that it may be provided extra pleats 
to provide compliance about the ©z axis. Bellows 27 may compensate for air volume 
changes in housing 37 due to Z-axis movements of bellows 26. Bellows 27 may be 
preferably attached to mounting block 35 so that the movement of bellows 27 is directly 
hand powered and said bellows 27 therefore does not lag behind until a sufficient air 

20 pressure differential might cause a sudden movement of said bellows 27, which might in . 
turn cause an unintended sudden movement of bellows 26 and therefore of transducer 
assembly 25, which could thus cause spurious signals. The small size of transducer 
assembly 25 may facilitate the use of a grip 24 that is small enough to allow reliable 
gripping even while the operator's thumb and forefinger are used to actuate typical game- 

25 style joystick buttons or triggers. 

Referring to Figures 11a, lib, 11c and lid Permanent magnet 53 may be held 
between (magnetic) spring grip 56 and (magnetic) pole piece 52 by (non-magnetic) stud 
55 and nut 54. The lower end of (non-magnetic) spring 10 may be fixed to (non- 
magnetic) spring platform 51, which may be shaped to engage said spring 10. Three 

30 (non-magnetic) spacers 21 position (non-magnetic) spring platform 51 above magnetic 

pole piece 52 and printed circuit board 13. Six magnetic flux sensors such as Hall Effect 

sensors 50a, 50b, 50c, 50d, 50e, and 50f may be fixed to printed circuit 13 and located 

such that displacement of the spring suspended assembly comprised of magnetic grip 1, 

spring grip 56, stud 55, nut 54, and pole piece 52 along any translational axis or about any 
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rotational axis may produce a unique output signal from the combined set of magnetic 
flux sensors 50a, 50b, 50c, 50d, 50e, and 50f. Pole piece 52 may feature three poles: 52a 
(located between magnetic flux sensors 50a and 50b), 52b (located between magnetic flux 
sensors 50e and 50f) and 52c (located between magnetic flux sensors 50c and 50d). Said 
5 poles, at the null position, are angularly, with respect to the Z-axis, located exactly 
between their respective magnetic flux sensors. In elevation view, each of said poles may 
be located above the plane defined by the position of the magnetically responsive 
elements within said magnetic flux sensors. In this manner the vector dot products of the 
local magnetic flux and the maximum sensitivity axis of each of said magnetic flux 

1 0 sensors may create a pattern of signals uniquely representing the position of said spring 
suspended assembly. The six vectors of maximum sensitivity (maximum change in 
signal of individual magnetic flux sensors versus change in position of the respective 
pole) may define a shape in space similar to a hexapod or Stewart Platform. Spacers 21 
and pole piece 52 may be shaped to limit the travel of said spring mounted assembly in 

15 the horizontal plane or about the Z-axis. Downward movement (along the Z-axis) may be 
limited as the end of stud 55 engages printed circuit board 13. Upward movement of said 
spring mounted assembly may be limited as pole piece 52 engages spring platform 51. 
Each of the contacting surfaces of pole piece 52, spacers 21, circuit board 13 and spring 
platform 51 could, of course, be appropriately covered with non-abrading impact 

20 absorbing material. This might be accomplished, for example, by rubber coating of pole 
piece 52 and using a smooth acorn nut as nut 54 in conjunction with a nylon wear plate 
attached to the top of circuit board 13. A comfortable grip material such as a soft rubber 
sleeve could be applied to outside of grip 1. Each said magnetic flux sensor may be 
preferably an integrated circuit such as a type 3503 ratiometric, linear Hall-Effect sensor 

25 as manufactured by Allegro Microsystems, Inc. which type includes an amplifier to 
facilitate subsequent signal handling. Signal handling may be accomplished by any of 
numerous known methods such as by use of analog to digital conversion boards or 
programmable interface chips (PIC®) such as those manufactured by Microchip 
Corporation. Optionally, a de-Gaussing coil may be added to the assembly to reduce any 

30 undesirable prior magnetization. 

Referring to Fig. 12, a plan view of the flux path is shown without a magnetic 

grip. Referring to Fig. 13, a plan view is shown indicating the magnetic flux path with a 

magnetic grip. Referring to Fig. 13a, the magnetic flux path 57 is shown in elevation 

view. The use of a return magnetic flux path through the grip may allow the flux to carry 
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further from the pole pieces, resulting in better mechanical clearances, greater range of 
movement and better ergonomics. 

Referring to Fig. 14, a circuit board 13 is shown with magnetic flux sensors 50a, 
50b, 50c, 50d, 50e and 50f. Damping circuits 58 and 59 may be provided to serve a 
5 function similar to Amortisseur windings in rotating electric machines. Discrete resistors 
may optionally be provided in the damping circuits such as 58 and 59. 

Referring to Figures 15a through 15e, grip 1 may be connected to the upper end of 
elastomeric sensing element 60. 

It shpuld be noted that the terms "upper" and "lower" are used simply to facilitate 

1 0 description of the various drawings and are specifically intended to not be limiting with 
respect to any disclosure or any claims. The various multi-axial input devices herein 
described are each capable of operating in any orientation with respect to gravity. 

The lower end of elastomeric sensing element 60, which may be a conductive 
elastomeric element, and which may be ionically conductive, may be fixed to pedestal 63, 

1 5 which may be fixed to base portion 64. The upper end of sensing element 60 may be 
fitted with electrical terminals 61a, 61b, and 61c. The lower end of elastomeric sensing 
element 60 may be fitted with electrical terminals 62a, 62b, and 62c. Said electrical 
terminals may also be used for mechanical attachment of grip #1 and pedestal 63 to the 
elastomeric sensing element 63. Lower printed circuit board 67 and upper printed circuit 

20 board 66 may be used to facilitate electrical connection to elastomeric sensing element 
60. Upper circuit board 66 may be fastened to elastomeric sensing element 60 by means 
of fasteners 68 and may also be fastened to grip 1 by means of fastener 69. Circuit board 
62 may be clamped between pedestal 63 and elastomeric sensing element 60 by means of 
fasteners 65. Fasteners 65 may also serve to attach pedestal 63 to base portion 64. 

25 Referring to Fig. 16, upper circuit board 66 may be configured to facilitate use of multiple 
fasteners 69 for attachment to grip 1. Referring again to Figures 15a through 15d, upper 
electrical terminals 61a, 61b, and 61c are preferably equally spaced 120 degrees apart. 
Electrical terminals 62a, 62b, and 62c are also preferably equally spaced 120 degrees 
apart and are also preferably offset angularly from upper electrical terminals by 60 

30 degrees. In this manner, the electrically conductive elastomeric sensing element 60, in 

combination with said electrical terminals, may function as a variable resistance circuit as 

represented in Fig. 17. Note that Fig. 17 is a planar representation of a three dimensional 

electrical circuit, which may be thought of as a cross section of the elastomeric sensing 

element 60 of Fig. 15a through 15e cut along either a circular or hexagonal pattern 
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intercepting electrical terminals 61a, 61b, 61c, 62a, 62b, and 62c. Referring again to Fig. 
17, variable resistor 70a, for example, may represent the variable resistance between 
electrical terminals 61a and 62a, which resistance may vary as elastomeric sensing 
element 60 is deformed. Said three dimensional electrical circuit may be in the general 
5 shape of the actuator geometry of a Stewart Platform. Importantly, six degrees of 
freedom of the deflections of elastomeric sensing element 60 may be uniquely 
represented by the resistive electrical characteristics between electrical terminals 61a, 
61b, 61c, 62a, 62b, and 62c. Elastomeric sensing element 60 may be made from a wide 
variety of materials of several classes. In one embodiment of this invention, the 

1 0 elastomeric material may be a solid solution of a metal salt dissolved in a polymer, such 
as that described in U.S. Pat. Nos. 5,898,057, 6,063,499, 6,111,051, or 6,184,331 to 
Chiang et al. or as commercially available from Mearthane Products Corp. In the case of 
said solid solution of a metal salt dissolved in a polymer, the electrical excitation signal is 
preferably of alternating polarity. Such an elastomer may be referred to hereafter as 

1 5 ionically conducting. For example, a three phase alternating current supply may be used 
as depicted in Fig. 45. Alternatively, the elastomeric sensing element 60 may be an 
"intrinsically conductive polymer" (ICP) such as Polyaniline (PAni) developed by 
Zipperling Kessler & Co. or blends of such polymers. Alternatively, polymers with 
conductive fillers may be used but may not be preferred due to inconsistent and often 

20 non-linear strain-resistivity relationships. 

Referring to Figures 18a, 18b, 18c, and 18d, various views are shown of another 
embodiment of an elastomeric sensing element 60 of this invention. Upper electrical 
terminals are designated 61a, 61b, and 61c. Lower electrical terminals are designated 
62a, 62b, and 62c. This embodiment may be superior to the embodiment of Figures 15a 

25 through 15e due to a reduced or eliminated electrical current through equivalent 
resistances 71a, 71b, 71c, 72a, 72b, and 72c as depicted in Fig. 17. Additionally, the 
mechanical stiffness along the various axes may be readily tailored by controlling the 
shapes and angles of the elastomeric "legs" 70a, 70b, 70c, 70d, 70e, and 70f. 

Referring to Fig. 18e, a representative equivalent circuit is shown wherein 

30 variable resistances 70a through 70f represent the resistances of the "legs" of the same 
designation in Figures 18a through 18d. 

Referring to Figures 19a, 19b, 19c, and 19d, various views are shown of yet 
another embodiment of the current invention wherein a plurality of discrete elastomeric 
sensing elements 75a, 75b, 75c, 75d, 75e, and 75f may replace the single elastomeric 
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sensing element 60 of the preceding figures. Electrical terminals 72a through 72f and 73 a 
through 73f may fix said elastomeric sensing elements to upper circuit board 66 and 
lower circuit board 67. The upper circuit board 66 and lower circuit board 67 may be 
fixed to a grip and pedestal or base portion as depicted in other views. The size and shape 
5 of the discrete sensing elements may be selected to optimize the stiffiiess characteristics, 
strength, and ergonomic feel along each axis. 

Referring to Fig. 19e, a representative equivalent circuit is shown corresponding 
to the plurality of elastomeric sensing elements of Figures 19a through 19d. 

Referring to Fig. 20a and Fig. 20 b, a plan view and cross section view, 

1 0 respectively, are shown of another embodiment of the present invention wherein a cavity 
76 containing an electrically conducting liquid or gel, hereinafter referred to simply as 
"electrolyte", may be provided within a deformable elastomeric structure 77. A 
deformable element containing an ionically conducting liquid may hereafter be referred to 
as a deformable liquid element A defrormable element containing an ionically 

15 conducting gel may hereafter be referred to as a deformable gel element. Such 
deformable elements may be deformed with respect to electrical resistance by elongation, 
shortening, dilation, narrowing, electrode shading, etc. A plurality of electrical terminals 
81a, 81b, 81c, 82a, 82b, and 82c may provide for connection of appropriate electrical 
circuitry for measurement of electrical resistance along various axes. Upper electrical 

20 terminals 81a, 81b, and 81c are preferably equally spaced 120 degrees apart and are 
preferably angularly offset from lower electrical terminals 82a, 2b, and 82c, which are 
also equally spaced 120 degrees apart. The outer rim of elastomeric structure 77 may be 
radially stiffened by insert 78. A cover 80 may be used to shield electrical terminals 81a, 
81b, and 81c. Retainer 79 may be used to fix elastomeric structure 77 to pedestal 63. 

25 Referring now to Figures 21a through 21f various views are shown of another 

embodiment of this invention wherein a plurality of discrete elastomeric elements such as 
lengths of rubber hose 83 each containing electrolyte are provided. Hose clamps 84 may 
secure electrodes 81 and 82. Mounting platforms 85 and 86 position the various 
electrodes 81 and 82 and may transmit various applied forces thereto. Any deflection of 

30 platforms 85 and 86 relative to each other may cause a unique pattern of electrical 
resistance between the various electrical terminals 81 and 82. Elongation of any of the 
various elastomeric elements 83 may result in a longer distance between electrodes and a 
narrower cross section of electrolyte and thus a higher resistance. Measurement of said 
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resistances may be preferably done with an excitation signal of alternating polarity in 
conjunction with standard am detection circuitry. 

Referring now to Fig. 22, a cross section is shown cut along a hexagonal path of 
yet another embodiment of the present invention. Various stages of manufacture and 
5 assembly are indicated as follows: Elastomeric structure 87 may be molded with pins 88 
in place. Pins 88 may be withdrawn leaving cavities 89. Electrodes 90 may be inserted 
into the bottom of elastomeric structure 87. Cavities 89 may then be filled with 
electrolyte 92. Upper electrodes 93 may then be inserted, sealing off electrolyte 92 within 
cavities 89. Electrical connections 94 may complete the assembly of the sensing element 

1 0 portion of this embodiment of this invention. 

Referring now to Fig. 23, two out of six sensing element assemblies are depicted 
in a configuration that may provide for greater sensitivity than is provided by the 
embodiment of Fig. 22. The nominal distance between upper electrodes 95 and lower 
electrodes 96 is small compared to the height of elastomeric structure 87, resulting in a 

1 5 greater relative change in electrode spacing for a given deflection of elastomeric structure 
87. 

Referring now to Fig. 24, an embodiment is depicted which may require insertion 
of only a single electrode assembly 97 into each cavity within elastomeric structure 87. 
This embodiment may be simpler to manufacture and may be less affected by small 

20 amounts of air entrained within the cavities during assembly. 

Referring now to Figures 25a, 25b, and 25c, another embodiment of the present 
invention is shown wherein a deformable elastomeric structure 100 may contain a 
plurality of internal stiffening elements 99 which may couple strains of elastomeric 
structure 100 along selected axes to strains which are more easily measured by a compact 

25 device 98 such as an array of printed circuit board strain gauges or one or more MEMS 
force sensors. 

Referring now to Fig. 26, a partial view of another embodiment of the present 
invention is shown wherein stiffening elements 99 may be coupled to pressure sensing 
means 101 through fluid filled channels 102. 
30 Referring to Fig. 27, a cross section of another embodiment of the present 

invention is shown wherein a deformable elastomeric structure 77 may be provided to 
which displacement measurement devices 103 may be pivotably attached at locations 104 
within a common cavity 105. Stiffening insert 78 may provide radial stiffness to the outer 
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rim of elastomeric structure 77. Preferably, six measurement devices 103 are provided in 
the geometry of a Stewart platform. 

Referring now to Fig. 28, a partial cross section of another embodiment of the 
present invention is shown wherein displacement measuring devices 103 are fitted within 
5 discrete cavities 106 within elastomeric structure 100. 

Referring now to Fig. 29, a partial cross section view is shown depicting another 
embodiment of the present invention wherein displacement measuring devices such as 
variable inductors or differential transformers are installed within individual cavities 
within a deformable elastomeric structure. The embodiment shown further may provide 

10 for use of a single molded spherical seat 104 for each individual transducer 103. The 
partial cross section view of Fig. 29 depicts two of the preferred quantity of six 
transducers 103 which may be preferably oriented in a Stewart Platform configuration. 
Spherical portion 106 of transducer assembly 103 may be seated in molded spherical seat 
104 within elastomeric body 100. Transformer cores 105 may feature spherical outside 

15 diameters which may slide within coil assemblies 106. Rod portions 107 connect 
spherical portions 106 with transformer cores 105. 

Referring now to Fig. 30, coil springs 108 within elastomeric structure 100 may vary in 
inductance as they change length with deformation of elastomeric structure 100. 
Variance in inductance may be measured in order to establish an electronic representation 

20 of the deformed shape of elastomeric structure 100. 

Referring to Fig. 31, elastomeric structure 100 may feature inflatable cavities 89 
within coils or coil springs 108. Inflatable cavities 89 may be connected to an external 
source of compressed fluid or gas by means of fittings 109 and hoses 110. Inflatable 
cavities 89 may be preferably provided in quantity six in a Stewart Platform configuration 

25 within elastomeric structure 100. By way of this embodiment a force feedback or 
"haptic" joystick may be constructed. A combination of six of the two elements shown 
may be termed a "stage" of an actuator. By mounting multiple independently operable 
"stages" end-on-end, a robotic, snake-like device may be constructed with great 
flexibility and controllability. Such a multi-stage device may be useful for catheter 

30 steering for medical applications, for example. Control of such multiple stage devices 
may preferably be by means of single pressure manifolds in conjunction with miniature 
valve manifolds such as MEMS valve assemblies that are preferably addressed and 
actuated from a single digital data bus. In this manner, a single compressed air line in 
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conjunction with a single data bus could be collocated along the center of an extended 
multi-stage actuator in a structure analogous to an vertebrate animal spine. 

Referring now to Figures 32a through 32d, another embodiment of the present 
invention is shown wherein an electrolyte filled elastomeric sensing element 77 (similar 
5 to that shown in Figures 20a and 20b) is used in combination with a gel filled wrist rest 
111 and a numeric key-pad 112. The axis of symmetry of elastomeric sensing element 77 
may be inclined from vertical to allow the user's hand to be in a comfortable and relaxed 
position. The bottom 64a of base portion 64 could normally sit flat on a horizontal 
surface such as a desk. 

10 Referring now to Fig. 33, yet another embodiment of the present invention is 

shown wherein left half 113 of game controller 116 may be connected to the right half 
114 of game controller 116 by means of multi-axis sensing element 115. By means of 
this embodiment, all of the conventional features of a two handed game controller may be 
preserved while six, for example, additional degrees of freedom may be added. 

1 5 Referring now to Fig. 34, a wrist mounted embodiment of the present invention is 

depicted wherein hand strap 117 and wrist strap 118 may secure base portion 1 19 to the 
user's hand 120. Active grip 1 may be connected to base portion 119 through sensor 
portion 121. 

Referring now to Figures 35a through 35g, 36a and 36b, photographs of a model 
20 of another embodiment of the present invention are shown whereby twelve degrees of 
freedom may be readily controlled with one hand. Fingertip operated grip 122 is 
connected by sensor means 121 (not shown) to hand held grip 123. The fingertip operated 
grip 122 may be preferably approximately 1 to VA inches in diameter, a possibly novel 
level of compactness which the sensor means disclosed by this invention may facilitate. 
25 Additional sensor means for measurement of hand held grip inputs may be located within 
hand held grip 123 or at the base of connecting link 124, or within connecting link 124 or 
may be achieved by external, e.g., video measurement means. 

Referring now to Fig. 37a, 37b, 38a, 38b, 38c, and 38d, photographs are shown 
depicting yet another embodiment of the present invention wherein a hand held stationary 
30 grip 125 may be used to stabilize the user's hand while active grip 122 may be operated 
in multiple degrees of freedom, six for example, by the user's thumb, forefinger, and 
middle finger. 

Referring now to Fig. 39, an example of one of many alternative electrical 
schematics for one class of embodiments of the present invention is shown. 
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Referring to Fig. 40a, a perspective view is shown of an elastomeric sensing 
element in accordance with one of the embodiments of this invention. 

Referring now to Fig. 40b, a cross sectional view is shown of the sensing element 
of Fig. 40a. 

5 Referring now to Fig. 41, an elevation view is shown of an embodiment of the 

present invention that incorporates a plurality of electrically conductive elastomeric 
tensile members. 

Referring now to Fig. 42, one of many possible representative electrical 

schematics is shown of one class of embodiments of the present invention. 

10 Referring now to Fig. 43, one of many possible representative electrical 

schematics is shown of another embodiment of the present invention. 

Referring now to Fig. 44, an example schematic is shown of an electrolyte filled 

cavity of Stewart Platform geometry within a deformable elastomeric sensing element in 

accordance with one embodiment of the present invention. 

15 Referring now to Fig. 45, a representative electrical schematic is shown 

corresponding to the embodiment of Fig. 44. 

Referring now to Fig. 46, a cross section is shown of an embodiment of the 

present invention similar to the embodiment shown in Figures 15a through 15e. 

Referring now to Fig. 47, an example electrical signal scheme is shown wherein a 

20 three phase excitation Voltage represented by Voltages A, B, and C is applied to one set 

of terminals such as 61a, 61b, and 61c of the embodiment of Figures 15a through 15e. 

Six degree of freedom position information may be obtained, for example, by 

measurement of the Voltage and phase angle of Voltages D, E, and F as would be 

available for measurement at terminals 62a, 62b, and 62c in the embodiment of Figures 

25 15a through 15e. 

Referring to Fig. 48, a printed circuit board is shown which might be used in 

conjunction with the embodiment of Fig. 46. 

Referring now to Figures 49a, 49b, 49c, and 49d, a joystick is shown which 

features a base 64 to which is mounted a gel pad wrist rest 111 which allows the user 

30 comfortably clamp the base 64 securely against a supporting surface 126 such as a desk 

during manipulation of the joystick. Pedestal 63 is attached to base 64 and may be 

shaped to prevent excessive rotation or horizontal movement of lower grip portion lb. 

Lower grip portion lb is accordingly shaped to allow desirable but not excessive 

movement about pedestal 63. The movement of lower grip portion lb is limited in the 
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downward direction by base 64 and is limited in the upward direction by pedestal 63. 
Diaphragm 2 is convoluted along several directions to provide flexibility in six degrees of 
freedom and provides protection of the optical components from dust and insects. Spring 
10 provides a restoring force to the grip la and lb and also locates by way of holes 10a 
5 and 10b the upper grip relative to the photo emitters 4 and photo detectors 5. Lower grip 
lb is also located relative to pedestal 63 by means of spring 10. Spring 10 is depicted 
with three way symmetry. Spring 10 may have any number of configurations such as 
two way symmetry or it may be constructed with a single spiral element Upper grip la 
features an internal surface with a combination of absorptive zones lc and reflective 

10 zones Id.. Emitters 4 may be aimed directly at the boundaries betweens zones lc and 
zones Id. Photo detectors 5 may have a wide field of view and may each be responsive to 
the reflected light from several photo emitters. If the photo emitters are energized one at 
a time, all of the photo detectors, photo diodes for example, may be electrically connected 
in parallel and may be connected to a single analog input channel of a mixed signal 

1 5 integrated circuit such as a Microchip PIC® device. Such a device may be mounted 
directly to circuit board 13 along with other electronic components which may be 
required to direct power to the photo emitters 4 and to derive a signal from the phot 
detectors 5. Upper grip la as shown in Figures 49a, 49b, 49c and 49 d is drawn in this 
example at 53 mm diameter. 

20 Referring now to Figures 50a and 50b, an embodiment of the present invention is shown 
which incorporates a monolithic photo transducer 44. Pedestal 63 is attached to base 64 
and may be shaped to prevent excessive rotation or horizontal movement of lower grip 
portion lb. Lower grip portion lb is accordingly shaped to allow desirable but not 
excessive movement about pedestal 63. The movement of lower grip portion lb is 

25 limited in the downward direction by base 64 and is limited in the upward direction by 
pedestal 63. Diaphragm 2 is convoluted along several directions to provide flexibility in 
six degrees of freedom and provides protection of the optical components from dust and 
insects. Spring 10 provides a restoring force to the grip la and lb and also locates by 
way of holes 10a and 10b the upper grip relative to the photo emitters 4 and photo 

30 detectors 5. Lower grip lb is also located relative to pedestal 63 by means of spring 10. 

Spring 10 is depicted with three way symmetry. Spring 10 may have any number of 

configurations such as two way symmetry or it may be constructed with a single spiral 

element. Upper grip la features an internal surface with a combination of absorptive 

zones lc and reflective zones Id.. Emitters 44c may be aimed directly at the boundaries 
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betweens zones lc and zones Id. Photo detectors 44b may have a wide field of view and 
may each be responsive to the reflected light from several photo emitters. Figures 50 a, 
50b, and 50c are drawn to a scale such that upper grip la is approximately 40 mm in 
diameter, thus rendering it operable with the user's thumb tip, index finger tip, and 
5 middle finger tip and leaving the users remaining fingers available to grip a further device 
such as a mouse or joystick to which base 64 may be attached. 

Referring now to Fig. 50c, the monolithic optical transducer 44 of Figures 50a and 
50b is shown. Monolithic optical transducer 44 is comprised of a substrate 44e which 
may be a printed circuit board, six discrete photo emitters 44c and six discrete photo 

1 0 detectors 44b may each be encased in a transparent medium such as epoxy resin. An 
opaque medium may surround the transparent medium in order to prevent direct 
transmission of light between the photo emitters and photo detectors. A reflective coating 
44j may be applied to the outer surface of the transparent medium 44h prior to over- 
molding for example with opaque medium 44i. Connection pins 44a provide power to 

1 5 and transmit data from the device by means of a an interface such as USB for example. 
Mixed signal microcontroller 44d and other electronic components as may be required 
may be mounted to substrate 44e and encapsulated is resin systems 44h and/or 44i. In 
this maimer a low cost robust transducer package may be produced. 

Referring now to figures 51a, 51b, 51c, 51d, 51e, 51f, and 51g, an embodiment of 

20 the present invention is shown wherein a six axis joystick 1 as attached to a three axis 
mouse 64a. The mouse is shaped to allow the users wrist to be substantially vertical thus 
permitting greater range of z axis rotation of the mouse base. The depicted shape also 
facilitates firm grasping of the mouse portion against the user's palm by the user's ring 
firnger and little finger. A ridge between the users palm and bent fingers further enhances 

25 security of gripping. The joystick is approximately 40 mm in diameter and thus allows 
easy manipulation with the user's thumb, index finger and middle finger. The bottom 
surface of the mouse features two sets of offset conventional optical mouse transducers. 
Each transducer set may measure both x and y movements, although the transducer set at 
one of the two locations need only measure x movements. For nomenclature purposes, 

30 the transducer sets lie along a line parallel to the y axis. The third mouse axis is derived 
from z axis twisting of the mouse which causes a differential output of the two x 
transducers. The depicted device provides 9 degrees of freedom, buttons may also be 
provided around the periphery of the base of the six axis joystick. A small ten key pad 
may be added to the top of the device. 
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Referring now to Fig. 52, another embodiment of the present invention is shown 
wherein a joystick 1 controls a hexapod adaptor 126 which controls the spatial 
relationship between a piece of construction equipment 131, in this case a loader, and a 
removable implement 133 , in this case a bucket Various other implements such as 
5 forks, grapples, booms, saws, hammers, augers, drills, mowers, etc. may be similarly 
controlled. Machine vision sensor 130 which may be a video camera is used to machine 
determine the posture of the linkage 127 relative to the joystick 1. The machine vision 
sensor 130 may also be used to sense the posture of the hexapod 126. The posture of 
hexapod stage 126 may also be interpreted by machine vision means such as by video 

1 0 camera or scanning laser beam. Such a laser beam might, for example scan reflective 
tags on each of the six struts. The timing of the reflected signals might be used to 
determine the posture of the hexapod. Various other machine vision schemes could also 
be used. Altternatively or conjunctively posture information may be deduced from 
discrete sensors such as MEMS (Micro Mechanical Electrical Systems) devices 126c 

1 5 attached to attached to the hexapod struts and MEMS devices 126b and 126d attached to 
platforms 128 and 132. Further MEMS devices (which may be accelerometers or angular 
rate sensors for example) 127a and 129a may be attached to the various parts of the 
linkage 127 of a machine. Such devices may be attached magnetically and preferably 
transmit information wirelessly. 

20 Exhibit A illustrates a general approach to determining the position, angular 

velocity, and angular acceleration of amachine element on the basis of MEMS 
accelerometer data. A similar approach may be used to determine the position, angular 
velocity, and angular acceleration of multiple connected linkages such as robotic arms, 
hexapods, combinations thereof and the like. 

25 Referring now to Fig. 53, a partial general control arrangement is shown which 

might be used in conjunction with the embodiment shown in Fig. 52. Joystick 1 is used 
by the operator to control slave platform 132. Coordinates are continuously adjusted to 
match the user's frame of reference by computer 139 using machine vision sensor 130 
and/or discrete sensors 127a, 127b, 126c, 126d, and the like. Conventional absolute angle 

30 and position encoders may also be utilized. Hexapod struts 126 may be hydraulically 
controlled by hydraulic valve manifold 137, which may receive electrical power through 
motion controller 134 from hydraulic electrical generator 136. Hydraulic electrical 
generator 136 may also supply electrical power to transceiver 135. Transciever 135 may 
receive motion command data from transceiver 138. Such a scheme is adaptable to a 
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wide variety of machinery. Installation of such equipment need not be permanent and 
may be well suited even to rental construction equipment. In general, the accuracy of the 
posture determining system need only be sufficient to reasonably align the hexapod, for 
example, frame of reference with the frame of reference of the operator. Absolute 
5 position feedback would be in direct visual or audible directly to the operator, 
independent of the control system. Optionally, a haptic joystick could be utilized to 
provided tactile force feedback. 

As can be easily understood from the foregoing, the basic concepts of the present 
invention may be embodied in a variety of ways. It involves both multi-axis input 

1 0 techniques as well as devices to accomplish the appropriate method. In this application, 
the multi-axis input techniques are disclosed as part of the results shown to be achieved 
by the various devices described and as steps which are inherent to utilization. They are 
simply the natural result of utilizing the devices as intended and described. In addition, 
while some devices are disclosed, it should be understood that these not only accomplish 

1 5 certain methods but also can be varied in a number of ways. Importantly, as to all of the 
foregoing, all of these facets should be understood to be encompassed by this disclosure. 

The discussion included in this application is intended to serve as a basic 
description. The reader should be aware that the specific discussion may not explicitly 
describe all embodiments possible; many alternatives are implicit. It also may not fully 

20 explain the generic nature of the invention and may not explicitly show how each feature 
or element can actually be representative of a broader function or of a great variety of 
alternative or equivalent elements. Again, these are implicitly included in this disclosure. 
Where the invention is described in device-oriented terminology, each element of the 
device implicitly performs a function. Not only are apparatus claims included for the 

25 device described, but also method or process claims may be included to address the 
functions the invention and each element performs. Neither the description nor the 
terminology is intended to limit the scope of the claims which will be included in a full 
patent application. 

It should also be understood that a variety of changes may be made without 

30 departing from the essence of the invention. Such changes are also implicitly included in 

the description. They still fall within the scope of this invention. A broad disclosure 

encompassing both the explicit embodiment(s) shown, the great variety of implicit 

alternative embodiments, and the broad methods or processes and the like are 

encompassed by this disclosure and may be relied upon for support of the claims for the 
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full patent application. It should be understood that such language changes and broad 
claiming is accomplished in this application based on a provisional filing. This patent 
application may seek examination of as broad a base of claims as deemed within the 
applicant's right and is designed to yield a patent covering numerous aspects of the 
5 invention both independently and as an overall system. 

Further, each of the various elements of the invention and claims may also be 
achieved in a variety of manners. This disclosure should be understood to encompass 
each such variation, be it a variation of an embodiment of any apparatus embodiment, a 
method or process embodiment, or even merely a variation of any element of these. 

1 0 Particularly, it should be understood that as the disclosure relates to elements of the 
invention, the words for each element may be expressed by equivalent apparatus terms or 
method terms — even if only the function or result is the same. Such equivalent, broader, 
or even more generic terms should be considered to be encompassed in the description of 
each element or action. Such terms can be substituted where desired to make explicit the 

15 implicitly broad coverage to which this invention is entitled. As but one example, it 
should be understood that all actions may be expressed as a means for taking that action 
or as an element which causes that action. Similarly, each physical element disclosed 
should be understood to encompass a disclosure of the action which that physical element 
facilitates. Regarding this last aspect, as but one example, the disclosure of a "means for 

20 detecting" or a "detector" should be understood to encompass disclosure of the act of 
"detecting" - whether explicitly discussed or not — and, conversely, were there 
effectively disclosure of the act of "detecting", such a disclosure should be understood to 
encompass disclosure of a "detector" and even a "means for detecting". Such changes and 
alternative terms are to be understood to be explicitly included in the description. 

25 Patents, publications, or other references mentioned in this application for patent 

are hereby incorporated by reference. In addition, as to each term used it should be 
understood that unless its utilization in this application is inconsistent with such 
interpretation, both traditional and common dictionary definitions should be understood 
as incorporated for each term and all definitions, alternative terms, and synonyms such as 

30 contained in the Random House Webster's Unabridged Dictionary, second edition are 

hereby incorporated by reference. Finally, all references listed in the list of References 

To Be Incorporated By Reference In Accordance With The Patent Application or other 

information statement or list of references filed with the application are hereby appended 

and hereby incorporated by reference, however, as to each of the above, to the extent that 
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such information or statements incorporated by reference might be considered 
inconsistent with the patenting of this invention such statements are expressly not to be 
considered as made by the applicants. 

Thus, the applicants should be understood to claim at least i) each of the input 
5 devices as herein disclosed and described, ii) the related methods disclosed and described, 

iii) similar, equivalent, and even implicit variations of each of these devices and methods, 

iv) those alternative designs which accomplish each of the functions shown as are 
disclosed and described, v) those alternative designs and methods which accomplish each 
of the functions shown as are implicit to accomplish that which is disclosed and 

10 described, vi) each feature, component, and step shown as separate and independent 
inventions, vii) the applications enhanced by the various systems or components 
disclosed, viii) the resulting products produced by such systems or components, be) 
methods and apparatuses substantially as described hereinbefore and with reference to 
any of the accompanying examples, x) the various combinations and permutations of each 

15 of the elements disclosed, xi) each potentially dependent claim or concept as a 
dependency on each and every one of the independent claims or concepts presented, xii) 
processes performed with the aid of or on a computer as described throughout the above 
discussion, xiii) a programmable apparatus as described throughout the above discussion, 
xiv) a computer readable memory encoded with data to direct a computer comprising > 

20 means or elements which function as described throughout the above discussion, xv) a 
computer configured as herein disclosed and described, xvi) individual or combined 
subroutines and programs as herein disclosed and described, xvii) the related methods 
disclosed and described, xviii) similar, equivalent, and even implicit variations of each of 
these systems and methods, xix) those alternative designs which accomplish each of the 

25 functions shown as are disclosed and described, xx) those alternative designs and 
methods which accomplish each of the functions shown as are implicit to accomplish that 
which is disclosed and described, xxi) each feature, component, and step shown as 
separate and independent inventions, and xxii) the various combinations and permutations 
of each of the above. 
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It should also be understood that for practical reasons and so as to avoid adding 
potentially hundreds of claims, the applicant may eventually present claims with initial 
dependencies only. Support should be understood to exist to the degree required under 
new matter laws - including but not limited to European Patent Convention Article 
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123(2) and United States Patent Law 35 USC 132 or other such laws- to permit the 
addition of any of the various dependencies or other elements presented under one 
independent claim or concept as dependencies or elements under any other independent 
claim or concept. Further, if or when used, the use of the transitional phrase 
5 "comprising" is and will be used to maintain the "open-end" claims herein, according to 
traditional claim interpretation. Thus, unless the context requires otherwise, it should be 
understood that the term "comprise" or variations such as "comprises" or "comprising", 
are intended to imply the inclusion of a stated element or step or group of elements or 
steps but not the exclusion of any other element or step or group of elements or steps. 
10 Such terms should be interpreted in their most expansive form so as to afford the 
applicant the broadest coverage legally permissible. 

Any claims set forth at any time are hereby incorporated by reference as part of 
this description of the invention, and the applicant expressly reserves the right to use all 
of or a portion of such incorporated content of such claims as additional description to 
1 5 support any of or all of the claims or any element or component thereof, and the applicant 
further expressly reserves the right to move any portion of or all of the incorporated 
content of such claims or any element or component thereof from the description into the 
claims or vice-versa as necessary to define the matter for which protection is sought by 
this application or by any subsequent continuation, division, or continuation-in-part 
20 application thereof, or to obtain any benefit of, reduction in fees pursuant to, or to comply 
with the patent laws, rules, or regulations of any country or treaty, and such content 
incorporated by reference shall survive during the entire pendency of this application 
including any subsequent continuation, division, or continuation-in-part application 
thereof or any reissue or extension thereon. 

25 
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(1) 1-D accelerometer at each point, A 
and B, both oriented parallel to radius 
and away from center. X-axis taken 
along moving element, y-axis 
perpendicular to element as shown. (1) 
1-D accelerometer parallel to y-axis and 
fixed at A. 



Accelerations at each point: 
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where — and — are tangential velocities. 



\g\ = Jgl +gl » so finding g y gives: g x = J g 2 - g * 
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S>ince V A = r A 0 and V B = r B -9, we may write: 
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So: 
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